2024-01-27T13:15:12.100 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-27T13:15:12.100 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443 --owner scheduled_yuriw@teuthology --name yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/orig.config.yaml 2024-01-27T13:15:12.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T13:15:12.232 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7534443' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4613 sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSiUJLD7NupzrbLNMQlJkAwwNfMl33iRfrA6vxAJLhAVxjq3Ty5GbVp6DlyXBbJp/VdpttpZSFScR0DKKRdIv8= smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAM43CzzKNHAgRaevX71/zsxlDd9gm3zQ//qqeybgcK1bd5MV8ACud4PV6AJPCj8K49YmP2/mjYFQEgbCuxvt1Q= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-26_15:05:59 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-27T13:15:12.233 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa; will attempt to use it 2024-01-27T13:15:12.233 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks 2024-01-27T13:15:12.234 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-27T13:15:12.235 INFO:teuthology.task.internal:Checking packages... 2024-01-27T13:15:12.259 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f' 2024-01-27T13:15:12.259 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-27T13:15:12.260 INFO:teuthology.packaging:ref: None 2024-01-27T13:15:12.260 INFO:teuthology.packaging:tag: None 2024-01-27T13:15:12.260 INFO:teuthology.packaging:branch: main 2024-01-27T13:15:12.260 INFO:teuthology.packaging:sha1: 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:15:12.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-01-27T13:15:12.477 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-918.g37d5d931 2024-01-27T13:15:12.480 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-27T13:15:12.487 INFO:teuthology.task.internal:no buildpackages task found 2024-01-27T13:15:12.487 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-27T13:15:12.506 INFO:teuthology.task.internal:Saving configuration 2024-01-27T13:15:12.522 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-27T13:15:12.529 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-27T13:15:12.553 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 13:10:16.272142', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSiUJLD7NupzrbLNMQlJkAwwNfMl33iRfrA6vxAJLhAVxjq3Ty5GbVp6DlyXBbJp/VdpttpZSFScR0DKKRdIv8='} 2024-01-27T13:15:12.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 13:10:16.274197', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAM43CzzKNHAgRaevX71/zsxlDd9gm3zQ//qqeybgcK1bd5MV8ACud4PV6AJPCj8K49YmP2/mjYFQEgbCuxvt1Q='} 2024-01-27T13:15:12.580 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-27T13:15:12.587 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-27T13:15:12.587 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-01-27T13:15:12.587 INFO:teuthology.run_tasks:Running task console_log... 2024-01-27T13:15:12.663 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5153502430>, signals=[15]) 2024-01-27T13:15:12.664 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-27T13:15:12.670 INFO:teuthology.task.internal:Opening connections... 2024-01-27T13:15:12.671 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:15:12.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:15:12.780 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T13:15:12.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:15:12.871 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-27T13:15:12.879 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-01-27T13:15:12.898 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-01-27T13:15:12.899 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-01-27T13:15:12.957 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T13:15:12.958 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-27T13:15:12.958 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T13:15:12.958 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-01-27T13:15:12.990 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-01-27T13:15:13.007 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-01-27T13:15:13.008 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-01-27T13:15:13.064 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-01-27T13:15:13.064 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-01-27T13:15:13.064 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-01-27T13:15:13.064 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-01-27T13:15:13.064 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-01-27T13:15:13.064 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-27T13:15:13.065 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-27T13:15:13.065 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-01-27T13:15:13.089 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-27T13:15:13.098 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-27T13:15:13.106 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-27T13:15:13.106 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-01-27T13:15:13.109 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-01-27T13:15:13.124 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-27T13:15:13.131 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-27T13:15:13.131 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-01-27T13:15:13.167 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-01-27T13:15:13.247 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-27T13:15:13.303 INFO:teuthology.run_tasks:Running task kernel... 2024-01-27T13:15:13.317 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-27T13:15:13.317 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-27T13:15:13.318 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-27T13:15:13.318 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-27T13:15:13.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T13:15:13.335 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-01-27T13:15:13.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T13:15:13.336 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-01-27T13:15:13.393 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-361.el9.x86_64 2024-01-27T13:15:13.393 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-361.el9.x86_64 2024-01-27T13:15:13.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-01-27T13:15:13.395 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-361.el9.x86_64 2024-01-27T13:15:13.395 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-361.el9.x86_64 2024-01-27T13:15:13.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-01-27T13:15:15.689 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.4 MB 00:00 2024-01-27T13:15:15.721 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-9 - AppStream 9.4 MB/s | 6.4 MB 00:00 2024-01-27T13:15:17.273 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2024-01-27T13:15:17.288 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-01-27T13:15:18.272 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-01-27T13:15:20.686 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.0 MB 00:03 2024-01-27T13:15:21.989 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 19 MB 00:02 2024-01-27T13:15:27.573 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 5.9 MB 00:02 2024-01-27T13:15:28.949 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 15 kB 00:00 2024-01-27T13:15:30.253 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-01-27T13:15:31.161 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 20 MB 00:02 2024-01-27T13:15:34.504 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 5.9 MB 00:00 2024-01-27T13:15:36.138 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-01-27T13:15:36.275 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-01-27T13:15:37.475 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-01-27T13:15:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-27T13:15:38.640 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-27T13:15:38.740 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-27T13:15:38.744 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 99 M 2024-01-27T13:15:38.745 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 122 M 2024-01-27T13:15:38.746 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-01-27T13:15:39.193 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 13 MB/s | 6.0 MB 00:00 2024-01-27T13:15:39.852 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 19 MB/s | 21 MB 00:01 2024-01-27T13:15:40.477 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 23 MB/s | 39 MB 00:01 2024-01-27T13:15:41.102 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-411.el9.x86_6 17 MB/s | 33 MB 00:01 2024-01-27T13:15:41.105 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-01-27T13:15:41.105 INFO:teuthology.orchestra.run.smithi046.stdout:Total 42 MB/s | 99 MB 00:02 2024-01-27T13:15:41.106 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-01-27T13:15:41.529 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-01-27T13:15:41.530 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-01-27T13:15:42.314 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-01-27T13:15:42.601 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-01-27T13:15:42.602 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-01-27T13:15:44.529 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-27T13:15:44.529 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-27T13:15:44.621 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-01-27T13:15:44.636 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-01-27T13:15:44.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:15:44.638 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 99 M 2024-01-27T13:15:44.638 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 122 M 2024-01-27T13:15:44.638 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-01-27T13:15:45.132 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 12 MB/s | 6.0 MB 00:00 2024-01-27T13:15:45.158 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-01-27T13:15:45.841 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 17 MB/s | 21 MB 00:01 2024-01-27T13:15:45.848 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-27T13:15:45.985 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T13:15:46.633 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 20 MB/s | 39 MB 00:01 2024-01-27T13:15:46.933 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-core-5.14.0-411.el9.x86_6 19 MB/s | 33 MB 00:01 2024-01-27T13:15:46.936 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-01-27T13:15:46.936 INFO:teuthology.orchestra.run.smithi078.stdout:Total 43 MB/s | 99 MB 00:02 2024-01-27T13:15:46.936 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-01-27T13:15:47.312 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-01-27T13:15:47.312 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-01-27T13:15:48.341 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-01-27T13:15:48.342 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-01-27T13:15:48.900 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T13:15:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T13:15:50.745 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-01-27T13:15:51.448 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-27T13:15:51.576 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T13:15:54.139 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T13:15:54.248 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:15:54.312 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T13:15:54.487 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T13:15:59.167 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T13:15:59.330 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:15:59.368 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:04.065 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:29.993 INFO:teuthology.orchestra.run.smithi046.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-27T13:16:29.993 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:16:30.065 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-27T13:16:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T13:16:30.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T13:16:30.907 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:30.907 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:16:30.907 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-01-27T13:16:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-27T13:16:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-27T13:16:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-27T13:16:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-27T13:16:30.908 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:16:30.908 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-01-27T13:16:31.399 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T13:16:31.578 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T13:16:31.578 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T13:16:31.579 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-27T13:16:31.579 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-27T13:16:31.579 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-27T13:16:31.579 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-27T13:16:31.579 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-01-27T13:16:31.580 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T13:16:31.692 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T13:16:31.693 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T13:16:31.693 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 68.el9 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8264254 2024-01-27T13:16:31.735 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-01-27T13:16:31.736 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:16:31.737 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-01-27T13:16:31.737 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-27T13:16:31.738 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-411.el9.x86_64 2024-01-27T13:16:31.738 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-27T13:16:32.377 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-01-27T13:16:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:33.380 INFO:teuthology.orchestra.run.smithi078.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-27T13:16:33.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:16:33.451 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:33.836 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:33.836 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-27T13:16:33.836 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-27T13:16:33.836 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-27T13:16:34.000 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[38067]) leaked on vgs invocation. Parent PID 18141: grub2-probe 2024-01-27T13:16:34.000 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37411]) leaked on vgs invocation. Parent PID 18141: grub2-probe 2024-01-27T13:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 3 (pipe:[38067]) leaked on vgs invocation. Parent PID 18141: grub2-probe 2024-01-27T13:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:File descriptor 9 (pipe:[37411]) leaked on vgs invocation. Parent PID 18141: grub2-probe 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.224 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.225 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:16:34.225 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-01-27T13:16:34.239 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-27T13:16:34.269 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-01-27T13:16:34.271 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-01-27T13:16:34.286 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.gcaxcf3Vdj 2024-01-27T13:16:34.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gcaxcf3Vdj 2024-01-27T13:16:34.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.gcaxcf3Vdj 2024-01-27T13:16:34.511 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.gcaxcf3Vdj is 6KB 2024-01-27T13:16:34.597 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.gcaxcf3Vdj 2024-01-27T13:16:34.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-01-27T13:16:34.680 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-27T13:16:34.681 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-27T13:16:34.681 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-27T13:16:34.681 INFO:teuthology.orchestra.run.smithi046.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-27T13:16:34.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.747 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T13:16:34.826 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-01-27T13:16:34.884 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.884 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T13:16:34.885 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-27T13:16:34.885 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-27T13:16:34.885 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-27T13:16:34.885 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-27T13:16:34.885 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-01-27T13:16:34.885 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-01-27T13:16:34.992 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-27T13:16:34.993 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-27T13:16:34.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 68.el9 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8264254 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-27T13:16:35.027 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:16:35.028 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-01-27T13:16:35.029 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-27T13:16:35.029 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-411.el9.x86_64 2024-01-27T13:16:35.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-27T13:16:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-01-27T13:16:36.994 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-27T13:16:37.030 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-01-27T13:16:37.033 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-01-27T13:16:37.047 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.crlD8wcRkw 2024-01-27T13:16:37.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.crlD8wcRkw 2024-01-27T13:16:37.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.crlD8wcRkw 2024-01-27T13:16:37.261 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.crlD8wcRkw is 6KB 2024-01-27T13:16:37.309 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.crlD8wcRkw 2024-01-27T13:16:37.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-01-27T13:16:37.399 INFO:teuthology.orchestra.run.smithi078.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-27T13:16:37.399 INFO:teuthology.orchestra.run.smithi078.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-27T13:16:37.399 INFO:teuthology.orchestra.run.smithi078.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-27T13:16:37.399 INFO:teuthology.orchestra.run.smithi078.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-27T13:16:37.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-27T13:16:37.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-01-27T13:17:04.856 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-27T13:17:04.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T13:17:04.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:17:07.544 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-27T13:17:07.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-27T13:17:07.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:17:39.516 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-27T13:17:48.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T13:17:48.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:18:06.908 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-27T13:18:07.548 DEBUG:teuthology.orchestra.remote:timed out 2024-01-27T13:18:16.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-27T13:18:16.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:18:17.012 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-01-27T13:18:17.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-27T13:18:17.444 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-411.el9.x86_64"... 2024-01-27T13:18:17.444 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-01-27T13:18:17.458 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-411.el9.x86_64 2024-01-27T13:18:17.458 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-27T13:18:17.458 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-27T13:18:17.458 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-27T13:18:18.459 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-27T13:18:18.459 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-27T13:18:18.524 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-01-27T13:18:18.556 DEBUG:teuthology.parallel:result is None 2024-01-27T13:18:18.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T13:18:18.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:18:19.338 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-27T13:18:19.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T13:18:19.894 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-411.el9.x86_64"... 2024-01-27T13:18:19.894 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-01-27T13:18:19.908 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-411.el9.x86_64 2024-01-27T13:18:19.908 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-27T13:18:19.908 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-27T13:18:19.908 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-27T13:18:20.909 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-27T13:18:20.909 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-27T13:18:21.004 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-01-27T13:18:21.035 DEBUG:teuthology.parallel:result is None 2024-01-27T13:18:21.035 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-27T13:18:21.043 INFO:teuthology.task.internal:Creating test directory... 2024-01-27T13:18:21.044 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-27T13:18:21.046 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-27T13:18:21.061 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-27T13:18:21.068 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-27T13:18:21.076 INFO:teuthology.task.internal:Creating archive directory... 2024-01-27T13:18:21.076 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-27T13:18:21.102 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-27T13:18:21.130 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-27T13:18:21.139 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-27T13:18:21.140 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-27T13:18:21.165 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-27T13:18:21.192 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T13:18:21.202 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T13:18:21.204 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T13:18:21.215 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-27T13:18:21.217 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-27T13:18:21.255 INFO:teuthology.task.internal:Configuring sudo... 2024-01-27T13:18:21.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-27T13:18:21.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-27T13:18:21.293 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-27T13:18:21.306 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-27T13:18:21.306 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-27T13:18:21.328 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-27T13:18:21.351 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T13:18:21.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T13:18:21.473 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T13:18:21.555 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T13:18:21.597 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:18:21.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-27T13:18:21.668 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T13:18:21.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-27T13:18:21.796 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T13:18:21.847 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-27T13:18:21.913 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:18:21.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-27T13:18:22.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-01-27T13:18:22.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-01-27T13:18:22.056 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T13:18:22.162 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T13:18:22.597 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-27T13:18:22.604 INFO:teuthology.task.internal:Starting timer... 2024-01-27T13:18:22.604 INFO:teuthology.run_tasks:Running task pcp... 2024-01-27T13:18:22.625 INFO:teuthology.run_tasks:Running task selinux... 2024-01-27T13:18:22.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-01-27T13:18:22.695 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-01-27T13:18:22.697 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-01-27T13:18:22.755 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-01-27T13:18:22.757 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-27T13:18:22.757 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-01-27T13:18:22.772 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-01-27T13:18:22.773 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-01-27T13:18:22.798 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-01-27T13:18:22.799 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi078.front.sepia.ceph.com': 'permissive'} 2024-01-27T13:18:22.799 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T13:18:22.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T13:18:22.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T13:18:22.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T13:18:22.870 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-27T13:18:22.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-01-27T13:18:22.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-01-27T13:18:22.950 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-27T13:18:22.962 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-27T13:18:22.967 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-27T13:18:23.088 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-27T13:18:23.104 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-27T13:18:23.106 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-27T13:22:34.917 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com')] 2024-01-27T13:22:34.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T13:22:34.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:22:35.016 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-27T13:22:35.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-27T13:22:35.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-27T13:22:35.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-27T13:22:35.189 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-01-27T13:22:35.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-01-27T13:22:35.263 INFO:teuthology.run_tasks:Running task clock... 2024-01-27T13:22:35.273 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-27T13:22:35.274 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-27T13:22:35.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T13:22:35.276 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-27T13:22:35.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T13:22:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-27T13:22:35.321 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-27T13:22:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-27T13:22:35.350 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-01-27T13:22:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-27T13:22:35.364 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-01-27T13:22:35.380 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-01-27T13:22:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-27T13:22:35.393 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-01-27T13:22:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-27T13:22:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-27T13:22:35.426 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-27T13:22:35.456 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-01-27T13:22:35.459 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T13:22:35.459 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-01-27T13:22:35.459 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.459 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.459 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.459 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-01-27T13:22:35.494 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T13:22:35.494 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-01-27T13:22:35.494 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T13:22:35.495 INFO:teuthology.run_tasks:Running task install... 2024-01-27T13:22:35.503 DEBUG:teuthology.task.install:project ceph 2024-01-27T13:22:35.503 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}} 2024-01-27T13:22:35.503 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'} 2024-01-27T13:22:35.504 INFO:teuthology.task.install:Using flavor: default 2024-01-27T13:22:35.509 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-27T13:22:35.509 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-27T13:22:35.510 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'tag': None, 'wait_for_package': False} 2024-01-27T13:22:35.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:22:35.512 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'tag': None, 'wait_for_package': False} 2024-01-27T13:22:35.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:22:35.728 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/ 2024-01-27T13:22:35.729 INFO:teuthology.task.install.rpm:Package version is 19.0.0-880.g99a21c3b 2024-01-27T13:22:35.746 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/ 2024-01-27T13:22:35.746 INFO:teuthology.task.install.rpm:Package version is 19.0.0-880.g99a21c3b 2024-01-27T13:22:35.857 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-27T13:22:35.857 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:22:35.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-27T13:22:35.887 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-27T13:22:35.887 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-27T13:22:35.896 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-27T13:22:35.896 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:22:35.896 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-27T13:22:35.924 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-27T13:22:35.925 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-27T13:22:35.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-27T13:22:35.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-27T13:22:36.034 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-27T13:22:36.072 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-27T13:22:36.100 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-01-27T13:22:36.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-01-27T13:22:36.139 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-01-27T13:22:36.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-01-27T13:22:36.347 INFO:teuthology.orchestra.run.smithi078.stdout:74 files removed 2024-01-27T13:22:36.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-27T13:22:36.380 INFO:teuthology.orchestra.run.smithi046.stdout:74 files removed 2024-01-27T13:22:36.407 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-27T13:22:37.033 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 234 kB/s | 80 kB 00:00 2024-01-27T13:22:37.110 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 211 kB/s | 80 kB 00:00 2024-01-27T13:22:37.450 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2024-01-27T13:22:37.527 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2024-01-27T13:22:37.851 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-01-27T13:22:37.878 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-01-27T13:22:38.300 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2024-01-27T13:22:38.445 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2024-01-27T13:22:39.756 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-01-27T13:22:39.854 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2024-01-27T13:22:40.961 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-01-27T13:22:41.583 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.0 MB 00:01 2024-01-27T13:22:43.854 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-01-27T13:22:44.499 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-01-27T13:22:47.755 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 15 MB/s | 5.9 MB 00:00 2024-01-27T13:22:48.573 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.9 MB 00:00 2024-01-27T13:22:49.773 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 15 kB 00:00 2024-01-27T13:22:49.957 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 15 kB 00:00 2024-01-27T13:22:51.491 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-01-27T13:22:56.432 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-01-27T13:22:56.494 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 20 MB 00:06 2024-01-27T13:22:59.054 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T13:22:59.055 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T13:22:59.088 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-27T13:22:59.089 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-27T13:22:59.090 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-27T13:22:59.091 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-27T13:22:59.093 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-27T13:22:59.096 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-27T13:22:59.097 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-27T13:22:59.175 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout:=================================================================================================== 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout:=================================================================================================== 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 6.5 k 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.1 M 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 67 M 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 411 M 2024-01-27T13:22:59.196 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 885 k 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.9 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 145 k 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.4 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 48 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.5 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 133 k 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 1.7 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 20 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 7.4 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 52 k 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 286 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 8.7 M 2024-01-27T13:22:59.197 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 M 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 46 M 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 664 M 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 262 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 742 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 217 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 27 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 18 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 31 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 741 k 2024-01-27T13:22:59.198 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.3 M 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 127 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 109 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 44 M 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 162 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 615 k 2024-01-27T13:22:59.199 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 321 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 771 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 298 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.1 M 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 337 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 85 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 509 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.3 M 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-01-27T13:22:59.200 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.4 M 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-27T13:22:59.201 INFO:teuthology.orchestra.run.smithi078.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 19 M 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 22 M 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 28 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 2.1 M 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 245 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.7 M 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 17 M 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 15 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 25 k 2024-01-27T13:22:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 163 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-27T13:22:59.203 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 499 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.8 M 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-27T13:22:59.204 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 45 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 130 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-27T13:22:59.205 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-27T13:22:59.206 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-27T13:22:59.207 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-27T13:22:59.208 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout:=================================================================================================== 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout:Install 161 Packages 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 16 Packages 2024-01-27T13:22:59.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:22:59.210 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 2.1 G 2024-01-27T13:22:59.210 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-01-27T13:22:59.775 INFO:teuthology.orchestra.run.smithi078.stdout:(1/177): ceph-19.0.0-880.g99a21c3b.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-01-27T13:23:00.417 INFO:teuthology.orchestra.run.smithi078.stdout:(2/177): ceph-base-19.0.0-880.g99a21c3b.el9.x86 5.9 MB/s | 5.1 MB 00:00 2024-01-27T13:23:01.541 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-01-27T13:23:04.239 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T13:23:04.239 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-27T13:23:04.274 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-27T13:23:04.275 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-27T13:23:04.276 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-27T13:23:04.277 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-27T13:23:04.279 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-27T13:23:04.282 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-27T13:23:04.283 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-27T13:23:04.365 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:=================================================================================================== 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:=================================================================================================== 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 6.5 k 2024-01-27T13:23:04.380 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.1 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 67 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 411 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 885 k 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.9 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 145 k 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.4 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 48 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.5 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 133 k 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 1.7 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 20 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 7.4 M 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 52 k 2024-01-27T13:23:04.381 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 M 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 286 M 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 8.7 M 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 M 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 46 M 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 664 M 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 262 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 742 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 217 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 27 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 18 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-27T13:23:04.382 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 31 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 741 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 5.3 M 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 127 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 109 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 44 M 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-27T13:23:04.383 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 162 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 615 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 321 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 771 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 298 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.1 M 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 99 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 337 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 85 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 509 k 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 52 M 2024-01-27T13:23:04.384 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 171 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 1.3 M 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-27T13:23:04.385 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.4 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 3.1 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 19 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-debuginfo x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 22 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 28 k 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 2.1 M 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 245 k 2024-01-27T13:23:04.386 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.7 M 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 17 M 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.0.0-880.g99a21c3b.el9 ceph-noarch 15 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 25 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 163 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-27T13:23:04.387 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 499 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 4.8 M 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-27T13:23:04.388 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 45 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.0.0-880.g99a21c3b.el9 ceph 130 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-27T13:23:04.389 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-27T13:23:04.390 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-27T13:23:04.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-27T13:23:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-01-27T13:23:04.393 INFO:teuthology.orchestra.run.smithi046.stdout:=================================================================================================== 2024-01-27T13:23:04.394 INFO:teuthology.orchestra.run.smithi046.stdout:Install 161 Packages 2024-01-27T13:23:04.394 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 16 Packages 2024-01-27T13:23:04.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:23:04.394 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.1 G 2024-01-27T13:23:04.394 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-01-27T13:23:05.501 INFO:teuthology.orchestra.run.smithi046.stdout:(1/177): ceph-19.0.0-880.g99a21c3b.el9.x86_64.r 15 kB/s | 6.5 kB 00:00 2024-01-27T13:23:05.617 INFO:teuthology.orchestra.run.smithi078.stdout:(3/177): ceph-common-19.0.0-880.g99a21c3b.el9.x 3.3 MB/s | 19 MB 00:05 2024-01-27T13:23:07.443 INFO:teuthology.orchestra.run.smithi046.stdout:(2/177): ceph-base-19.0.0-880.g99a21c3b.el9.x86 2.2 MB/s | 5.1 MB 00:02 2024-01-27T13:23:12.825 INFO:teuthology.orchestra.run.smithi078.stdout:(4/177): ceph-base-debuginfo-19.0.0-880.g99a21c 5.0 MB/s | 67 MB 00:13 2024-01-27T13:23:13.300 INFO:teuthology.orchestra.run.smithi078.stdout:(5/177): ceph-fuse-19.0.0-880.g99a21c3b.el9.x86 1.8 MB/s | 885 kB 00:00 2024-01-27T13:23:14.876 INFO:teuthology.orchestra.run.smithi046.stdout:(3/177): ceph-common-19.0.0-880.g99a21c3b.el9.x 2.1 MB/s | 19 MB 00:09 2024-01-27T13:23:14.892 INFO:teuthology.orchestra.run.smithi078.stdout:(6/177): ceph-fuse-debuginfo-19.0.0-880.g99a21c 3.7 MB/s | 5.9 MB 00:01 2024-01-27T13:23:15.009 INFO:teuthology.orchestra.run.smithi078.stdout:(7/177): ceph-immutable-object-cache-19.0.0-880 1.2 MB/s | 145 kB 00:00 2024-01-27T13:23:15.409 INFO:teuthology.orchestra.run.smithi078.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 3.6 MB/s | 1.4 MB 00:00 2024-01-27T13:23:16.001 INFO:teuthology.orchestra.run.smithi078.stdout:(9/177): ceph-mds-19.0.0-880.g99a21c3b.el9.x86_ 3.6 MB/s | 2.1 MB 00:00 2024-01-27T13:23:17.593 INFO:teuthology.orchestra.run.smithi078.stdout:(10/177): ceph-debuginfo-19.0.0-880.g99a21c3b.e 1.9 MB/s | 22 MB 00:11 2024-01-27T13:23:18.385 INFO:teuthology.orchestra.run.smithi078.stdout:(11/177): ceph-mgr-19.0.0-880.g99a21c3b.el9.x86 1.9 MB/s | 1.5 MB 00:00 2024-01-27T13:23:24.242 INFO:teuthology.orchestra.run.smithi046.stdout:(4/177): ceph-debuginfo-19.0.0-880.g99a21c3b.el 2.4 MB/s | 22 MB 00:09 2024-01-27T13:23:24.917 INFO:teuthology.orchestra.run.smithi046.stdout:(5/177): ceph-fuse-19.0.0-880.g99a21c3b.el9.x86 1.3 MB/s | 885 kB 00:00 2024-01-27T13:23:27.285 INFO:teuthology.orchestra.run.smithi078.stdout:(12/177): ceph-mgr-debuginfo-19.0.0-880.g99a21c 2.2 MB/s | 20 MB 00:08 2024-01-27T13:23:27.551 INFO:teuthology.orchestra.run.smithi046.stdout:(6/177): ceph-base-debuginfo-19.0.0-880.g99a21c 3.0 MB/s | 67 MB 00:22 2024-01-27T13:23:27.617 INFO:teuthology.orchestra.run.smithi046.stdout:(7/177): ceph-immutable-object-cache-19.0.0-880 2.1 MB/s | 145 kB 00:00 2024-01-27T13:23:27.710 INFO:teuthology.orchestra.run.smithi078.stdout:(13/177): ceph-mds-debuginfo-19.0.0-880.g99a21c 4.1 MB/s | 48 MB 00:11 2024-01-27T13:23:27.834 INFO:teuthology.orchestra.run.smithi046.stdout:(8/177): ceph-immutable-object-cache-debuginfo- 6.6 MB/s | 1.4 MB 00:00 2024-01-27T13:23:28.284 INFO:teuthology.orchestra.run.smithi046.stdout:(9/177): ceph-fuse-debuginfo-19.0.0-880.g99a21c 1.8 MB/s | 5.9 MB 00:03 2024-01-27T13:23:28.334 INFO:teuthology.orchestra.run.smithi046.stdout:(10/177): ceph-mds-19.0.0-880.g99a21c3b.el9.x86 4.2 MB/s | 2.1 MB 00:00 2024-01-27T13:23:28.660 INFO:teuthology.orchestra.run.smithi046.stdout:(11/177): ceph-mgr-19.0.0-880.g99a21c3b.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-01-27T13:23:29.052 INFO:teuthology.orchestra.run.smithi078.stdout:(14/177): ceph-mon-19.0.0-880.g99a21c3b.el9.x86 2.7 MB/s | 4.7 MB 00:01 2024-01-27T13:23:32.202 INFO:teuthology.orchestra.run.smithi046.stdout:(12/177): ceph-mgr-debuginfo-19.0.0-880.g99a21c 5.5 MB/s | 20 MB 00:03 2024-01-27T13:23:33.026 INFO:teuthology.orchestra.run.smithi046.stdout:(13/177): ceph-mon-19.0.0-880.g99a21c3b.el9.x86 5.7 MB/s | 4.7 MB 00:00 2024-01-27T13:23:35.072 INFO:teuthology.orchestra.run.smithi078.stdout:(15/177): ceph-osd-19.0.0-880.g99a21c3b.el9.x86 2.8 MB/s | 17 MB 00:06 2024-01-27T13:23:39.044 INFO:teuthology.orchestra.run.smithi078.stdout:(16/177): ceph-common-debuginfo-19.0.0-880.g99a 11 MB/s | 411 MB 00:38 2024-01-27T13:23:40.861 INFO:teuthology.orchestra.run.smithi078.stdout:(17/177): ceph-radosgw-19.0.0-880.g99a21c3b.el9 4.8 MB/s | 8.7 MB 00:01 2024-01-27T13:23:42.876 INFO:teuthology.orchestra.run.smithi046.stdout:(14/177): ceph-mds-debuginfo-19.0.0-880.g99a21c 3.3 MB/s | 48 MB 00:14 2024-01-27T13:23:47.693 INFO:teuthology.orchestra.run.smithi046.stdout:(15/177): ceph-osd-19.0.0-880.g99a21c3b.el9.x86 3.5 MB/s | 17 MB 00:04 2024-01-27T13:23:54.068 INFO:teuthology.orchestra.run.smithi046.stdout:(16/177): ceph-mon-debuginfo-19.0.0-880.g99a21c 4.7 MB/s | 99 MB 00:21 2024-01-27T13:23:55.484 INFO:teuthology.orchestra.run.smithi046.stdout:(17/177): ceph-radosgw-19.0.0-880.g99a21c3b.el9 6.1 MB/s | 8.7 MB 00:01 2024-01-27T13:24:00.359 INFO:teuthology.orchestra.run.smithi078.stdout:(18/177): ceph-mon-debuginfo-19.0.0-880.g99a21c 3.0 MB/s | 99 MB 00:32 2024-01-27T13:24:00.475 INFO:teuthology.orchestra.run.smithi078.stdout:(19/177): ceph-selinux-19.0.0-880.g99a21c3b.el9 216 kB/s | 25 kB 00:00 2024-01-27T13:24:04.908 INFO:teuthology.orchestra.run.smithi046.stdout:(18/177): ceph-common-debuginfo-19.0.0-880.g99a 7.2 MB/s | 411 MB 00:57 2024-01-27T13:24:05.025 INFO:teuthology.orchestra.run.smithi046.stdout:(19/177): ceph-selinux-19.0.0-880.g99a21c3b.el9 216 kB/s | 25 kB 00:00 2024-01-27T13:24:16.649 INFO:teuthology.orchestra.run.smithi046.stdout:(20/177): ceph-radosgw-debuginfo-19.0.0-880.g99 8.1 MB/s | 171 MB 00:21 2024-01-27T13:24:17.058 INFO:teuthology.orchestra.run.smithi046.stdout:(21/177): ceph-test-19.0.0-880.g99a21c3b.el9.x8 3.8 MB/s | 46 MB 00:12 2024-01-27T13:24:17.333 INFO:teuthology.orchestra.run.smithi046.stdout:(22/177): cephfs-mirror-19.0.0-880.g99a21c3b.el 791 kB/s | 217 kB 00:00 2024-01-27T13:24:17.425 INFO:teuthology.orchestra.run.smithi046.stdout:(23/177): cephfs-shell-19.0.0-880.g99a21c3b.el9 296 kB/s | 27 kB 00:00 2024-01-27T13:24:17.525 INFO:teuthology.orchestra.run.smithi046.stdout:(24/177): libcephfs-devel-19.0.0-880.g99a21c3b. 312 kB/s | 31 kB 00:00 2024-01-27T13:24:17.992 INFO:teuthology.orchestra.run.smithi046.stdout:(25/177): libcephfs2-19.0.0-880.g99a21c3b.el9.x 1.6 MB/s | 741 kB 00:00 2024-01-27T13:24:19.900 INFO:teuthology.orchestra.run.smithi046.stdout:(26/177): libcephfs2-debuginfo-19.0.0-880.g99a2 2.8 MB/s | 5.3 MB 00:01 2024-01-27T13:24:20.042 INFO:teuthology.orchestra.run.smithi046.stdout:(27/177): libcephsqlite-19.0.0-880.g99a21c3b.el 1.1 MB/s | 163 kB 00:00 2024-01-27T13:24:20.134 INFO:teuthology.orchestra.run.smithi046.stdout:(28/177): librados-devel-19.0.0-880.g99a21c3b.e 1.3 MB/s | 127 kB 00:00 2024-01-27T13:24:20.235 INFO:teuthology.orchestra.run.smithi046.stdout:(29/177): librados-devel-debuginfo-19.0.0-880.g 1.1 MB/s | 109 kB 00:00 2024-01-27T13:24:22.715 INFO:teuthology.orchestra.run.smithi078.stdout:(20/177): ceph-test-19.0.0-880.g99a21c3b.el9.x8 2.1 MB/s | 46 MB 00:22 2024-01-27T13:24:27.631 INFO:teuthology.orchestra.run.smithi078.stdout:(21/177): ceph-radosgw-debuginfo-19.0.0-880.g99 3.6 MB/s | 171 MB 00:46 2024-01-27T13:24:27.906 INFO:teuthology.orchestra.run.smithi078.stdout:(22/177): cephfs-mirror-19.0.0-880.g99a21c3b.el 791 kB/s | 217 kB 00:00 2024-01-27T13:24:27.998 INFO:teuthology.orchestra.run.smithi078.stdout:(23/177): cephfs-shell-19.0.0-880.g99a21c3b.el9 295 kB/s | 27 kB 00:00 2024-01-27T13:24:28.082 INFO:teuthology.orchestra.run.smithi078.stdout:(24/177): libcephfs-devel-19.0.0-880.g99a21c3b. 374 kB/s | 31 kB 00:00 2024-01-27T13:24:28.457 INFO:teuthology.orchestra.run.smithi078.stdout:(25/177): libcephfs2-19.0.0-880.g99a21c3b.el9.x 1.9 MB/s | 741 kB 00:00 2024-01-27T13:24:30.707 INFO:teuthology.orchestra.run.smithi078.stdout:(26/177): libcephfs2-debuginfo-19.0.0-880.g99a2 2.4 MB/s | 5.3 MB 00:02 2024-01-27T13:24:30.807 INFO:teuthology.orchestra.run.smithi078.stdout:(27/177): libcephsqlite-19.0.0-880.g99a21c3b.el 1.6 MB/s | 163 kB 00:00 2024-01-27T13:24:30.916 INFO:teuthology.orchestra.run.smithi078.stdout:(28/177): librados-devel-19.0.0-880.g99a21c3b.e 1.1 MB/s | 127 kB 00:00 2024-01-27T13:24:31.016 INFO:teuthology.orchestra.run.smithi078.stdout:(29/177): librados-devel-debuginfo-19.0.0-880.g 1.1 MB/s | 109 kB 00:00 2024-01-27T13:24:40.950 INFO:teuthology.orchestra.run.smithi046.stdout:(30/177): librados2-debuginfo-19.0.0-880.g99a21 2.1 MB/s | 44 MB 00:20 2024-01-27T13:24:41.225 INFO:teuthology.orchestra.run.smithi046.stdout:(31/177): libradosstriper1-19.0.0-880.g99a21c3b 1.8 MB/s | 499 kB 00:00 2024-01-27T13:24:46.765 INFO:teuthology.orchestra.run.smithi078.stdout:(30/177): librados2-debuginfo-19.0.0-880.g99a21 2.8 MB/s | 44 MB 00:15 2024-01-27T13:24:47.016 INFO:teuthology.orchestra.run.smithi078.stdout:(31/177): libradosstriper1-19.0.0-880.g99a21c3b 2.0 MB/s | 499 kB 00:00 2024-01-27T13:24:57.890 INFO:teuthology.orchestra.run.smithi046.stdout:(32/177): librbd1-debuginfo-19.0.0-880.g99a21c3 3.1 MB/s | 52 MB 00:16 2024-01-27T13:24:59.023 INFO:teuthology.orchestra.run.smithi046.stdout:(33/177): librgw2-19.0.0-880.g99a21c3b.el9.x86_ 4.2 MB/s | 4.8 MB 00:01 2024-01-27T13:24:59.107 INFO:teuthology.orchestra.run.smithi046.stdout:(34/177): python3-ceph-argparse-19.0.0-880.g99a 543 kB/s | 45 kB 00:00 2024-01-27T13:24:59.199 INFO:teuthology.orchestra.run.smithi046.stdout:(35/177): python3-ceph-common-19.0.0-880.g99a21 1.4 MB/s | 130 kB 00:00 2024-01-27T13:24:59.291 INFO:teuthology.orchestra.run.smithi046.stdout:(36/177): python3-cephfs-19.0.0-880.g99a21c3b.e 1.7 MB/s | 162 kB 00:00 2024-01-27T13:24:59.883 INFO:teuthology.orchestra.run.smithi046.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-880.g 1.0 MB/s | 615 kB 00:00 2024-01-27T13:25:00.058 INFO:teuthology.orchestra.run.smithi046.stdout:(38/177): python3-rados-19.0.0-880.g99a21c3b.el 1.8 MB/s | 321 kB 00:00 2024-01-27T13:25:00.291 INFO:teuthology.orchestra.run.smithi046.stdout:(39/177): python3-rados-debuginfo-19.0.0-880.g9 3.2 MB/s | 771 kB 00:00 2024-01-27T13:25:00.433 INFO:teuthology.orchestra.run.smithi046.stdout:(40/177): python3-rbd-19.0.0-880.g99a21c3b.el9. 2.1 MB/s | 298 kB 00:00 2024-01-27T13:25:00.673 INFO:teuthology.orchestra.run.smithi078.stdout:(32/177): librbd1-debuginfo-19.0.0-880.g99a21c3 3.8 MB/s | 52 MB 00:13 2024-01-27T13:25:00.792 INFO:teuthology.orchestra.run.smithi046.stdout:(41/177): python3-rbd-debuginfo-19.0.0-880.g99a 3.1 MB/s | 1.1 MB 00:00 2024-01-27T13:25:00.934 INFO:teuthology.orchestra.run.smithi046.stdout:(42/177): python3-rgw-19.0.0-880.g99a21c3b.el9. 701 kB/s | 99 kB 00:00 2024-01-27T13:25:01.226 INFO:teuthology.orchestra.run.smithi046.stdout:(43/177): python3-rgw-debuginfo-19.0.0-880.g99a 1.1 MB/s | 337 kB 00:00 2024-01-27T13:25:01.318 INFO:teuthology.orchestra.run.smithi046.stdout:(44/177): rbd-fuse-19.0.0-880.g99a21c3b.el9.x86 932 kB/s | 85 kB 00:00 2024-01-27T13:25:01.543 INFO:teuthology.orchestra.run.smithi046.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-880.g99a21c 2.2 MB/s | 509 kB 00:00 2024-01-27T13:25:02.356 INFO:teuthology.orchestra.run.smithi078.stdout:(33/177): librgw2-19.0.0-880.g99a21c3b.el9.x86_ 2.8 MB/s | 4.8 MB 00:01 2024-01-27T13:25:02.440 INFO:teuthology.orchestra.run.smithi078.stdout:(34/177): python3-ceph-argparse-19.0.0-880.g99a 543 kB/s | 45 kB 00:00 2024-01-27T13:25:02.532 INFO:teuthology.orchestra.run.smithi078.stdout:(35/177): python3-ceph-common-19.0.0-880.g99a21 1.4 MB/s | 130 kB 00:00 2024-01-27T13:25:02.618 INFO:teuthology.orchestra.run.smithi046.stdout:(46/177): rbd-mirror-19.0.0-880.g99a21c3b.el9.x 2.9 MB/s | 3.1 MB 00:01 2024-01-27T13:25:02.623 INFO:teuthology.orchestra.run.smithi078.stdout:(36/177): python3-cephfs-19.0.0-880.g99a21c3b.e 1.7 MB/s | 162 kB 00:00 2024-01-27T13:25:02.891 INFO:teuthology.orchestra.run.smithi078.stdout:(37/177): python3-cephfs-debuginfo-19.0.0-880.g 2.3 MB/s | 615 kB 00:00 2024-01-27T13:25:03.057 INFO:teuthology.orchestra.run.smithi078.stdout:(38/177): python3-rados-19.0.0-880.g99a21c3b.el 1.9 MB/s | 321 kB 00:00 2024-01-27T13:25:03.374 INFO:teuthology.orchestra.run.smithi078.stdout:(39/177): python3-rados-debuginfo-19.0.0-880.g9 2.4 MB/s | 771 kB 00:00 2024-01-27T13:25:03.541 INFO:teuthology.orchestra.run.smithi078.stdout:(40/177): python3-rbd-19.0.0-880.g99a21c3b.el9. 1.7 MB/s | 298 kB 00:00 2024-01-27T13:25:04.025 INFO:teuthology.orchestra.run.smithi078.stdout:(41/177): python3-rbd-debuginfo-19.0.0-880.g99a 2.3 MB/s | 1.1 MB 00:00 2024-01-27T13:25:04.125 INFO:teuthology.orchestra.run.smithi078.stdout:(42/177): python3-rgw-19.0.0-880.g99a21c3b.el9. 993 kB/s | 99 kB 00:00 2024-01-27T13:25:04.300 INFO:teuthology.orchestra.run.smithi078.stdout:(43/177): python3-rgw-debuginfo-19.0.0-880.g99a 1.9 MB/s | 337 kB 00:00 2024-01-27T13:25:04.401 INFO:teuthology.orchestra.run.smithi078.stdout:(44/177): rbd-fuse-19.0.0-880.g99a21c3b.el9.x86 852 kB/s | 85 kB 00:00 2024-01-27T13:25:04.651 INFO:teuthology.orchestra.run.smithi078.stdout:(45/177): rbd-fuse-debuginfo-19.0.0-880.g99a21c 2.0 MB/s | 509 kB 00:00 2024-01-27T13:25:05.685 INFO:teuthology.orchestra.run.smithi078.stdout:(46/177): rbd-mirror-19.0.0-880.g99a21c3b.el9.x 3.0 MB/s | 3.1 MB 00:01 2024-01-27T13:25:10.293 INFO:teuthology.orchestra.run.smithi078.stdout:(47/177): ceph-osd-debuginfo-19.0.0-880.g99a21c 3.0 MB/s | 286 MB 01:35 2024-01-27T13:25:10.518 INFO:teuthology.orchestra.run.smithi078.stdout:(48/177): rbd-nbd-19.0.0-880.g99a21c3b.el9.x86_ 760 kB/s | 171 kB 00:00 2024-01-27T13:25:11.051 INFO:teuthology.orchestra.run.smithi078.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-880.g99a21c3 2.3 MB/s | 1.3 MB 00:00 2024-01-27T13:25:11.185 INFO:teuthology.orchestra.run.smithi078.stdout:(50/177): ceph-grafana-dashboards-19.0.0-880.g9 213 kB/s | 28 kB 00:00 2024-01-27T13:25:11.318 INFO:teuthology.orchestra.run.smithi078.stdout:(51/177): ceph-mgr-cephadm-19.0.0-880.g99a21c3b 996 kB/s | 133 kB 00:00 2024-01-27T13:25:11.852 INFO:teuthology.orchestra.run.smithi078.stdout:(52/177): ceph-mgr-dashboard-19.0.0-880.g99a21c 3.3 MB/s | 1.7 MB 00:00 2024-01-27T13:25:14.002 INFO:teuthology.orchestra.run.smithi078.stdout:(53/177): ceph-mgr-diskprediction-local-19.0.0- 3.4 MB/s | 7.4 MB 00:02 2024-01-27T13:25:14.119 INFO:teuthology.orchestra.run.smithi078.stdout:(54/177): ceph-mgr-modules-core-19.0.0-880.g99a 2.1 MB/s | 245 kB 00:00 2024-01-27T13:25:14.238 INFO:teuthology.orchestra.run.smithi078.stdout:(55/177): ceph-mgr-rook-19.0.0-880.g99a21c3b.el 438 kB/s | 52 kB 00:00 2024-01-27T13:25:14.355 INFO:teuthology.orchestra.run.smithi078.stdout:(56/177): ceph-prometheus-alerts-19.0.0-880.g99 129 kB/s | 15 kB 00:00 2024-01-27T13:25:14.497 INFO:teuthology.orchestra.run.smithi078.stdout:(57/177): ceph-volume-19.0.0-880.g99a21c3b.el9. 1.8 MB/s | 262 kB 00:00 2024-01-27T13:25:14.798 INFO:teuthology.orchestra.run.smithi078.stdout:(58/177): cephadm-19.0.0-880.g99a21c3b.el9.noar 2.4 MB/s | 742 kB 00:00 2024-01-27T13:25:14.923 INFO:teuthology.orchestra.run.smithi078.stdout:(59/177): cephfs-top-19.0.0-880.g99a21c3b.el9.n 146 kB/s | 18 kB 00:00 2024-01-27T13:25:15.139 INFO:teuthology.orchestra.run.smithi078.stdout:(60/177): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 662 kB 00:00 2024-01-27T13:25:15.215 INFO:teuthology.orchestra.run.smithi078.stdout:(61/177): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-01-27T13:25:15.249 INFO:teuthology.orchestra.run.smithi078.stdout:(62/177): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-01-27T13:25:15.282 INFO:teuthology.orchestra.run.smithi078.stdout:(63/177): elfutils-libelf-devel-0.190-2.el9.x86 616 kB/s | 20 kB 00:00 2024-01-27T13:25:15.324 INFO:teuthology.orchestra.run.smithi078.stdout:(64/177): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-01-27T13:25:15.358 INFO:teuthology.orchestra.run.smithi078.stdout:(65/177): flexiblas-3.0.4-8.el9.x86_64.rpm 949 kB/s | 32 kB 00:00 2024-01-27T13:25:15.475 INFO:teuthology.orchestra.run.smithi078.stdout:(66/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-01-27T13:25:15.541 INFO:teuthology.orchestra.run.smithi078.stdout:(67/177): flexiblas-openblas-openmp-3.0.4-8.el9 258 kB/s | 17 kB 00:00 2024-01-27T13:25:15.575 INFO:teuthology.orchestra.run.smithi078.stdout:(68/177): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-01-27T13:25:15.617 INFO:teuthology.orchestra.run.smithi078.stdout:(69/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-01-27T13:25:15.651 INFO:teuthology.orchestra.run.smithi078.stdout:(70/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-01-27T13:25:15.701 INFO:teuthology.orchestra.run.smithi078.stdout:(71/177): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-01-27T13:25:15.743 INFO:teuthology.orchestra.run.smithi078.stdout:(72/177): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-01-27T13:25:15.777 INFO:teuthology.orchestra.run.smithi078.stdout:(73/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 734 kB/s | 24 kB 00:00 2024-01-27T13:25:15.810 INFO:teuthology.orchestra.run.smithi078.stdout:(74/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-01-27T13:25:15.852 INFO:teuthology.orchestra.run.smithi078.stdout:(75/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2024-01-27T13:25:15.886 INFO:teuthology.orchestra.run.smithi078.stdout:(76/177): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2024-01-27T13:25:15.919 INFO:teuthology.orchestra.run.smithi078.stdout:(77/177): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-01-27T13:25:16.078 INFO:teuthology.orchestra.run.smithi078.stdout:(78/177): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-01-27T13:25:16.170 INFO:teuthology.orchestra.run.smithi078.stdout:(79/177): openssl-devel-3.0.7-25.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2024-01-27T13:25:16.245 INFO:teuthology.orchestra.run.smithi078.stdout:(80/177): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2024-01-27T13:25:16.304 INFO:teuthology.orchestra.run.smithi078.stdout:(81/177): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2024-01-27T13:25:16.346 INFO:teuthology.orchestra.run.smithi078.stdout:(82/177): postgresql-private-libs-13.11-1.el9.x 3.1 MB/s | 134 kB 00:00 2024-01-27T13:25:16.832 INFO:teuthology.orchestra.run.smithi078.stdout:(83/177): rbd-mirror-debuginfo-19.0.0-880.g99a2 4.6 MB/s | 52 MB 00:11 2024-01-27T13:25:16.905 INFO:teuthology.orchestra.run.smithi078.stdout:(84/177): postgresql-server-13.11-1.el9.x86_64. 10 MB/s | 5.7 MB 00:00 2024-01-27T13:25:16.930 INFO:teuthology.orchestra.run.smithi078.stdout:(85/177): python3-attrs-20.3.0-7.el9.noarch.rpm 797 kB/s | 78 kB 00:00 2024-01-27T13:25:17.139 INFO:teuthology.orchestra.run.smithi078.stdout:(86/177): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-01-27T13:25:17.164 INFO:teuthology.orchestra.run.smithi078.stdout:(87/177): python3-jinja2-2.11.3-4.el9.noarch.rp 979 kB/s | 228 kB 00:00 2024-01-27T13:25:17.189 INFO:teuthology.orchestra.run.smithi078.stdout:(88/177): python3-jsonpatch-1.21-16.el9.noarch. 491 kB/s | 24 kB 00:00 2024-01-27T13:25:17.215 INFO:teuthology.orchestra.run.smithi078.stdout:(89/177): python3-jsonpointer-2.0-4.el9.noarch. 359 kB/s | 18 kB 00:00 2024-01-27T13:25:17.248 INFO:teuthology.orchestra.run.smithi078.stdout:(90/177): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-01-27T13:25:17.274 INFO:teuthology.orchestra.run.smithi078.stdout:(91/177): python3-markupsafe-1.1.1-12.el9.x86_6 538 kB/s | 32 kB 00:00 2024-01-27T13:25:17.424 INFO:teuthology.orchestra.run.smithi078.stdout:(92/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-01-27T13:25:17.449 INFO:teuthology.orchestra.run.smithi078.stdout:(93/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-01-27T13:25:17.475 INFO:teuthology.orchestra.run.smithi078.stdout:(94/177): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-01-27T13:25:17.500 INFO:teuthology.orchestra.run.smithi078.stdout:(95/177): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-01-27T13:25:17.525 INFO:teuthology.orchestra.run.smithi078.stdout:(96/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-01-27T13:25:17.550 INFO:teuthology.orchestra.run.smithi078.stdout:(97/177): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-01-27T13:25:17.575 INFO:teuthology.orchestra.run.smithi078.stdout:(98/177): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2024-01-27T13:25:17.601 INFO:teuthology.orchestra.run.smithi078.stdout:(99/177): python3-requests-oauthlib-1.3.0-12.el 857 kB/s | 43 kB 00:00 2024-01-27T13:25:17.885 INFO:teuthology.orchestra.run.smithi078.stdout:(100/177): python3-toml-0.10.2-6.el9.noarch.rpm 137 kB/s | 39 kB 00:00 2024-01-27T13:25:18.051 INFO:teuthology.orchestra.run.smithi078.stdout:(101/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-01-27T13:25:18.076 INFO:teuthology.orchestra.run.smithi078.stdout:(102/177): python3-wcwidth-0.2.5-8.el9.noarch.r 215 kB/s | 41 kB 00:00 2024-01-27T13:25:18.102 INFO:teuthology.orchestra.run.smithi078.stdout:(103/177): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-01-27T13:25:18.127 INFO:teuthology.orchestra.run.smithi078.stdout:(104/177): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-01-27T13:25:18.152 INFO:teuthology.orchestra.run.smithi078.stdout:(105/177): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.7 MB/s | 87 kB 00:00 2024-01-27T13:25:18.178 INFO:teuthology.orchestra.run.smithi078.stdout:(106/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-01-27T13:25:18.203 INFO:teuthology.orchestra.run.smithi078.stdout:(107/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-01-27T13:25:18.228 INFO:teuthology.orchestra.run.smithi078.stdout:(108/177): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-27T13:25:18.253 INFO:teuthology.orchestra.run.smithi078.stdout:(109/177): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-01-27T13:25:18.279 INFO:teuthology.orchestra.run.smithi078.stdout:(110/177): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-01-27T13:25:18.304 INFO:teuthology.orchestra.run.smithi078.stdout:(111/177): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 194 kB 00:00 2024-01-27T13:25:18.329 INFO:teuthology.orchestra.run.smithi078.stdout:(112/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-01-27T13:25:18.354 INFO:teuthology.orchestra.run.smithi078.stdout:(113/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-01-27T13:25:18.397 INFO:teuthology.orchestra.run.smithi078.stdout:(114/177): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2024-01-27T13:25:18.422 INFO:teuthology.orchestra.run.smithi078.stdout:(115/177): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-01-27T13:25:18.439 INFO:teuthology.orchestra.run.smithi078.stdout:(116/177): python3-pycparser-2.20-6.el9.noarch. 2.9 MB/s | 124 kB 00:00 2024-01-27T13:25:18.464 INFO:teuthology.orchestra.run.smithi078.stdout:(117/177): python3-requests-2.25.1-7.el9.noarch 2.7 MB/s | 113 kB 00:00 2024-01-27T13:25:18.489 INFO:teuthology.orchestra.run.smithi078.stdout:(118/177): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-01-27T13:25:18.707 INFO:teuthology.orchestra.run.smithi078.stdout:(119/177): python3-devel-3.9.17-2.el9.x86_64.rp 1.0 MB/s | 245 kB 00:00 2024-01-27T13:25:18.734 INFO:teuthology.orchestra.run.smithi046.stdout:(47/177): rbd-mirror-debuginfo-19.0.0-880.g99a2 3.2 MB/s | 52 MB 00:16 2024-01-27T13:25:18.781 INFO:teuthology.orchestra.run.smithi078.stdout:(120/177): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-01-27T13:25:18.809 INFO:teuthology.orchestra.run.smithi046.stdout:(48/177): rbd-nbd-19.0.0-880.g99a21c3b.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-01-27T13:25:18.982 INFO:teuthology.orchestra.run.smithi078.stdout:(121/177): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-01-27T13:25:19.024 INFO:teuthology.orchestra.run.smithi078.stdout:(122/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 623 kB/s | 26 kB 00:00 2024-01-27T13:25:19.082 INFO:teuthology.orchestra.run.smithi078.stdout:(123/177): liboath-2.6.7-2.el9.x86_64.rpm 833 kB/s | 49 kB 00:00 2024-01-27T13:25:19.117 INFO:teuthology.orchestra.run.smithi046.stdout:(49/177): rbd-nbd-debuginfo-19.0.0-880.g99a21c3 4.1 MB/s | 1.3 MB 00:00 2024-01-27T13:25:19.141 INFO:teuthology.orchestra.run.smithi078.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-01-27T13:25:19.176 INFO:teuthology.orchestra.run.smithi046.stdout:(50/177): ceph-grafana-dashboards-19.0.0-880.g9 488 kB/s | 28 kB 00:00 2024-01-27T13:25:19.241 INFO:teuthology.orchestra.run.smithi078.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-01-27T13:25:19.243 INFO:teuthology.orchestra.run.smithi046.stdout:(51/177): ceph-mgr-cephadm-19.0.0-880.g99a21c3b 1.9 MB/s | 133 kB 00:00 2024-01-27T13:25:19.558 INFO:teuthology.orchestra.run.smithi078.stdout:(126/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 838 kB 00:00 2024-01-27T13:25:19.660 INFO:teuthology.orchestra.run.smithi046.stdout:(52/177): ceph-mgr-dashboard-19.0.0-880.g99a21c 4.2 MB/s | 1.7 MB 00:00 2024-01-27T13:25:19.767 INFO:teuthology.orchestra.run.smithi078.stdout:(127/177): python3-asyncssh-2.13.2-3.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-01-27T13:25:19.808 INFO:teuthology.orchestra.run.smithi078.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-01-27T13:25:19.850 INFO:teuthology.orchestra.run.smithi078.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 775 kB/s | 32 kB 00:00 2024-01-27T13:25:19.893 INFO:teuthology.orchestra.run.smithi078.stdout:(130/177): python3-certifi-2021.10.8-2.el9.noar 361 kB/s | 15 kB 00:00 2024-01-27T13:25:19.985 INFO:teuthology.orchestra.run.smithi078.stdout:(131/177): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-01-27T13:25:20.143 INFO:teuthology.orchestra.run.smithi078.stdout:(132/177): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-01-27T13:25:20.268 INFO:teuthology.orchestra.run.smithi078.stdout:(133/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-01-27T13:25:20.302 INFO:teuthology.orchestra.run.smithi078.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 1.0 MB/s | 35 kB 00:00 2024-01-27T13:25:20.402 INFO:teuthology.orchestra.run.smithi078.stdout:(135/177): python3-google-auth-2.26.2-1.el9.noa 2.0 MB/s | 202 kB 00:00 2024-01-27T13:25:20.477 INFO:teuthology.orchestra.run.smithi078.stdout:(136/177): libarrow-9.0.0-10.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-01-27T13:25:20.503 INFO:teuthology.orchestra.run.smithi078.stdout:(137/177): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-01-27T13:25:20.528 INFO:teuthology.orchestra.run.smithi078.stdout:(138/177): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-01-27T13:25:20.553 INFO:teuthology.orchestra.run.smithi078.stdout:(139/177): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-01-27T13:25:20.578 INFO:teuthology.orchestra.run.smithi078.stdout:(140/177): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-01-27T13:25:20.604 INFO:teuthology.orchestra.run.smithi078.stdout:(141/177): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-01-27T13:25:20.646 INFO:teuthology.orchestra.run.smithi078.stdout:(142/177): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-01-27T13:25:20.704 INFO:teuthology.orchestra.run.smithi078.stdout:(143/177): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-01-27T13:25:20.755 INFO:teuthology.orchestra.run.smithi078.stdout:(144/177): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-01-27T13:25:20.863 INFO:teuthology.orchestra.run.smithi078.stdout:(145/177): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-01-27T13:25:20.905 INFO:teuthology.orchestra.run.smithi078.stdout:(146/177): python3-portend-3.1.0-2.el9.noarch.r 395 kB/s | 16 kB 00:00 2024-01-27T13:25:20.972 INFO:teuthology.orchestra.run.smithi078.stdout:(147/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-01-27T13:25:21.023 INFO:teuthology.orchestra.run.smithi078.stdout:(148/177): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-01-27T13:25:21.065 INFO:teuthology.orchestra.run.smithi078.stdout:(149/177): python3-repoze-lru-0.7-16.el9.noarch 742 kB/s | 31 kB 00:00 2024-01-27T13:25:21.135 INFO:teuthology.orchestra.run.smithi046.stdout:(53/177): ceph-mgr-diskprediction-local-19.0.0- 5.0 MB/s | 7.4 MB 00:01 2024-01-27T13:25:21.140 INFO:teuthology.orchestra.run.smithi078.stdout:(150/177): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-01-27T13:25:21.182 INFO:teuthology.orchestra.run.smithi078.stdout:(151/177): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-01-27T13:25:21.202 INFO:teuthology.orchestra.run.smithi046.stdout:(54/177): ceph-mgr-modules-core-19.0.0-880.g99a 3.6 MB/s | 245 kB 00:00 2024-01-27T13:25:21.224 INFO:teuthology.orchestra.run.smithi078.stdout:(152/177): python3-tempora-5.0.0-2.el9.noarch.r 858 kB/s | 36 kB 00:00 2024-01-27T13:25:21.260 INFO:teuthology.orchestra.run.smithi046.stdout:(55/177): ceph-mgr-rook-19.0.0-880.g99a21c3b.el 895 kB/s | 52 kB 00:00 2024-01-27T13:25:21.274 INFO:teuthology.orchestra.run.smithi078.stdout:(153/177): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-01-27T13:25:21.311 INFO:teuthology.orchestra.run.smithi046.stdout:(56/177): ceph-prometheus-alerts-19.0.0-880.g99 303 kB/s | 15 kB 00:00 2024-01-27T13:25:21.358 INFO:teuthology.orchestra.run.smithi078.stdout:(154/177): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2024-01-27T13:25:21.383 INFO:teuthology.orchestra.run.smithi078.stdout:(155/177): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-01-27T13:25:21.386 INFO:teuthology.orchestra.run.smithi046.stdout:(57/177): ceph-volume-19.0.0-880.g99a21c3b.el9. 3.4 MB/s | 262 kB 00:00 2024-01-27T13:25:21.475 INFO:teuthology.orchestra.run.smithi078.stdout:(156/177): python3-websocket-client-1.2.3-2.el9 767 kB/s | 90 kB 00:00 2024-01-27T13:25:21.542 INFO:teuthology.orchestra.run.smithi078.stdout:(157/177): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-01-27T13:25:21.569 INFO:teuthology.orchestra.run.smithi046.stdout:(58/177): cephadm-19.0.0-880.g99a21c3b.el9.noar 4.0 MB/s | 742 kB 00:00 2024-01-27T13:25:21.628 INFO:teuthology.orchestra.run.smithi046.stdout:(59/177): cephfs-top-19.0.0-880.g99a21c3b.el9.n 314 kB/s | 18 kB 00:00 2024-01-27T13:25:21.659 INFO:teuthology.orchestra.run.smithi078.stdout:(158/177): python3-werkzeug-2.0.3-3.el9.1.noarc 1.5 MB/s | 427 kB 00:00 2024-01-27T13:25:21.767 INFO:teuthology.orchestra.run.smithi078.stdout:(159/177): re2-20211101-3.el9.x86_64.rpm 851 kB/s | 192 kB 00:00 2024-01-27T13:25:21.862 INFO:teuthology.orchestra.run.smithi046.stdout:(60/177): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2024-01-27T13:25:22.020 INFO:teuthology.orchestra.run.smithi046.stdout:(61/177): bison-3.7.4-5.el9.x86_64.rpm 5.7 MB/s | 920 kB 00:00 2024-01-27T13:25:22.054 INFO:teuthology.orchestra.run.smithi046.stdout:(62/177): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-01-27T13:25:22.096 INFO:teuthology.orchestra.run.smithi046.stdout:(63/177): elfutils-libelf-devel-0.190-2.el9.x86 492 kB/s | 20 kB 00:00 2024-01-27T13:25:22.147 INFO:teuthology.orchestra.run.smithi046.stdout:(64/177): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-01-27T13:25:22.196 INFO:teuthology.orchestra.run.smithi046.stdout:(65/177): flexiblas-3.0.4-8.el9.x86_64.rpm 632 kB/s | 32 kB 00:00 2024-01-27T13:25:22.201 INFO:teuthology.orchestra.run.smithi078.stdout:(160/177): thrift-0.15.0-2.el9.x86_64.rpm 2.9 MB/s | 1.6 MB 00:00 2024-01-27T13:25:22.305 INFO:teuthology.orchestra.run.smithi046.stdout:(66/177): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-01-27T13:25:22.338 INFO:teuthology.orchestra.run.smithi046.stdout:(67/177): flexiblas-openblas-openmp-3.0.4-8.el9 518 kB/s | 17 kB 00:00 2024-01-27T13:25:22.372 INFO:teuthology.orchestra.run.smithi046.stdout:(68/177): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-01-27T13:25:22.414 INFO:teuthology.orchestra.run.smithi046.stdout:(69/177): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-01-27T13:25:22.448 INFO:teuthology.orchestra.run.smithi046.stdout:(70/177): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-01-27T13:25:22.506 INFO:teuthology.orchestra.run.smithi046.stdout:(71/177): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-01-27T13:25:22.548 INFO:teuthology.orchestra.run.smithi046.stdout:(72/177): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-01-27T13:25:22.582 INFO:teuthology.orchestra.run.smithi046.stdout:(73/177): libuuid-devel-2.37.4-15.el9.x86_64.rp 738 kB/s | 24 kB 00:00 2024-01-27T13:25:22.615 INFO:teuthology.orchestra.run.smithi046.stdout:(74/177): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-01-27T13:25:22.659 INFO:teuthology.orchestra.run.smithi046.stdout:(75/177): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.3 MB/s | 282 kB 00:00 2024-01-27T13:25:22.702 INFO:teuthology.orchestra.run.smithi046.stdout:(76/177): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-01-27T13:25:22.709 INFO:teuthology.orchestra.run.smithi078.stdout:(161/177): librados2-19.0.0-880.g99a21c3b.el9.x 3.6 MB/s | 3.4 MB 00:00 2024-01-27T13:25:22.735 INFO:teuthology.orchestra.run.smithi046.stdout:(77/177): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-01-27T13:25:22.751 INFO:teuthology.orchestra.run.smithi078.stdout:(162/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-01-27T13:25:22.802 INFO:teuthology.orchestra.run.smithi078.stdout:(163/177): librbd1-19.0.0-880.g99a21c3b.el9.x86 5.2 MB/s | 3.1 MB 00:00 2024-01-27T13:25:22.935 INFO:teuthology.orchestra.run.smithi078.stdout:(164/177): NetworkManager-1.45.10-1.el9.x86_64. 12 MB/s | 2.2 MB 00:00 2024-01-27T13:25:22.952 INFO:teuthology.orchestra.run.smithi046.stdout:(78/177): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-01-27T13:25:22.977 INFO:teuthology.orchestra.run.smithi078.stdout:(165/177): NetworkManager-libnm-1.45.10-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-01-27T13:25:23.002 INFO:teuthology.orchestra.run.smithi078.stdout:(166/177): NetworkManager-team-1.45.10-1.el9.x8 637 kB/s | 42 kB 00:00 2024-01-27T13:25:23.044 INFO:teuthology.orchestra.run.smithi078.stdout:(167/177): NetworkManager-tui-1.45.10-1.el9.x86 3.6 MB/s | 246 kB 00:00 2024-01-27T13:25:23.069 INFO:teuthology.orchestra.run.smithi078.stdout:(168/177): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2024-01-27T13:25:23.095 INFO:teuthology.orchestra.run.smithi078.stdout:(169/177): elfutils-debuginfod-client-0.190-2.e 706 kB/s | 35 kB 00:00 2024-01-27T13:25:23.120 INFO:teuthology.orchestra.run.smithi078.stdout:(170/177): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-01-27T13:25:23.145 INFO:teuthology.orchestra.run.smithi078.stdout:(171/177): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-01-27T13:25:23.162 INFO:teuthology.orchestra.run.smithi078.stdout:(172/177): libacl-2.3.1-4.el9.x86_64.rpm 531 kB/s | 22 kB 00:00 2024-01-27T13:25:23.238 INFO:teuthology.orchestra.run.smithi078.stdout:(173/177): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-01-27T13:25:23.330 INFO:teuthology.orchestra.run.smithi078.stdout:(174/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 13 MB/s | 2.1 MB 00:00 2024-01-27T13:25:23.344 INFO:teuthology.orchestra.run.smithi046.stdout:(79/177): openssl-devel-3.0.7-25.el9.x86_64.rpm 7.6 MB/s | 3.0 MB 00:00 2024-01-27T13:25:23.355 INFO:teuthology.orchestra.run.smithi078.stdout:(175/177): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2024-01-27T13:25:23.422 INFO:teuthology.orchestra.run.smithi078.stdout:(176/177): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-01-27T13:25:23.611 INFO:teuthology.orchestra.run.smithi046.stdout:(80/177): postgresql-13.11-1.el9.x86_64.rpm 5.7 MB/s | 1.5 MB 00:00 2024-01-27T13:25:23.886 INFO:teuthology.orchestra.run.smithi046.stdout:(81/177): postgresql-contrib-13.11-1.el9.x86_64 2.9 MB/s | 811 kB 00:00 2024-01-27T13:25:24.178 INFO:teuthology.orchestra.run.smithi046.stdout:(82/177): postgresql-private-libs-13.11-1.el9.x 459 kB/s | 134 kB 00:00 2024-01-27T13:25:24.537 INFO:teuthology.orchestra.run.smithi046.stdout:(83/177): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2024-01-27T13:25:24.787 INFO:teuthology.orchestra.run.smithi046.stdout:(84/177): python3-attrs-20.3.0-7.el9.noarch.rpm 311 kB/s | 78 kB 00:00 2024-01-27T13:25:25.121 INFO:teuthology.orchestra.run.smithi046.stdout:(85/177): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2024-01-27T13:25:25.371 INFO:teuthology.orchestra.run.smithi046.stdout:(86/177): python3-jinja2-2.11.3-4.el9.noarch.rp 914 kB/s | 228 kB 00:00 2024-01-27T13:25:25.446 INFO:teuthology.orchestra.run.smithi046.stdout:(87/177): python3-jsonpatch-1.21-16.el9.noarch. 327 kB/s | 24 kB 00:00 2024-01-27T13:25:25.497 INFO:teuthology.orchestra.run.smithi046.stdout:(88/177): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2024-01-27T13:25:25.539 INFO:teuthology.orchestra.run.smithi046.stdout:(89/177): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-01-27T13:25:25.572 INFO:teuthology.orchestra.run.smithi046.stdout:(90/177): python3-markupsafe-1.1.1-12.el9.x86_6 951 kB/s | 32 kB 00:00 2024-01-27T13:25:25.714 INFO:teuthology.orchestra.run.smithi046.stdout:(91/177): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-01-27T13:25:25.756 INFO:teuthology.orchestra.run.smithi046.stdout:(92/177): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-01-27T13:25:25.798 INFO:teuthology.orchestra.run.smithi046.stdout:(93/177): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2024-01-27T13:25:25.832 INFO:teuthology.orchestra.run.smithi046.stdout:(94/177): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-01-27T13:25:25.865 INFO:teuthology.orchestra.run.smithi046.stdout:(95/177): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-01-27T13:25:25.907 INFO:teuthology.orchestra.run.smithi046.stdout:(96/177): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-01-27T13:25:25.932 INFO:teuthology.orchestra.run.smithi046.stdout:(97/177): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2024-01-27T13:25:25.958 INFO:teuthology.orchestra.run.smithi046.stdout:(98/177): python3-requests-oauthlib-1.3.0-12.el 1.7 MB/s | 43 kB 00:00 2024-01-27T13:25:26.399 INFO:teuthology.orchestra.run.smithi046.stdout:(99/177): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-01-27T13:25:26.425 INFO:teuthology.orchestra.run.smithi046.stdout:(100/177): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2024-01-27T13:25:26.450 INFO:teuthology.orchestra.run.smithi046.stdout:(101/177): python3-wcwidth-0.2.5-8.el9.noarch.r 1.6 MB/s | 41 kB 00:00 2024-01-27T13:25:26.492 INFO:teuthology.orchestra.run.smithi046.stdout:(102/177): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-01-27T13:25:26.534 INFO:teuthology.orchestra.run.smithi046.stdout:(103/177): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-01-27T13:25:26.567 INFO:teuthology.orchestra.run.smithi046.stdout:(104/177): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.5 MB/s | 87 kB 00:00 2024-01-27T13:25:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:(105/177): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2024-01-27T13:25:26.643 INFO:teuthology.orchestra.run.smithi046.stdout:(106/177): zlib-devel-1.2.11-40.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2024-01-27T13:25:26.677 INFO:teuthology.orchestra.run.smithi046.stdout:(107/177): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-01-27T13:25:26.719 INFO:teuthology.orchestra.run.smithi046.stdout:(108/177): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-01-27T13:25:26.777 INFO:teuthology.orchestra.run.smithi046.stdout:(109/177): libgfortran-11.4.1-3.el9.x86_64.rpm 13 MB/s | 802 kB 00:00 2024-01-27T13:25:26.819 INFO:teuthology.orchestra.run.smithi046.stdout:(110/177): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 194 kB 00:00 2024-01-27T13:25:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:(111/177): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2024-01-27T13:25:26.895 INFO:teuthology.orchestra.run.smithi046.stdout:(112/177): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-01-27T13:25:26.962 INFO:teuthology.orchestra.run.smithi046.stdout:(113/177): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2024-01-27T13:25:26.995 INFO:teuthology.orchestra.run.smithi046.stdout:(114/177): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-01-27T13:25:27.037 INFO:teuthology.orchestra.run.smithi046.stdout:(115/177): python3-pycparser-2.20-6.el9.noarch. 2.9 MB/s | 124 kB 00:00 2024-01-27T13:25:27.071 INFO:teuthology.orchestra.run.smithi046.stdout:(116/177): python3-requests-2.25.1-7.el9.noarch 3.3 MB/s | 113 kB 00:00 2024-01-27T13:25:27.113 INFO:teuthology.orchestra.run.smithi046.stdout:(117/177): python3-urllib3-1.26.5-5.el9.noarch. 4.4 MB/s | 187 kB 00:00 2024-01-27T13:25:27.346 INFO:teuthology.orchestra.run.smithi046.stdout:(118/177): python3-devel-3.9.17-2.el9.x86_64.rp 1.0 MB/s | 245 kB 00:00 2024-01-27T13:25:27.655 INFO:teuthology.orchestra.run.smithi046.stdout:(119/177): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-01-27T13:25:27.797 INFO:teuthology.orchestra.run.smithi046.stdout:(120/177): gperftools-libs-2.9.1-2.el9.x86_64.r 2.1 MB/s | 309 kB 00:00 2024-01-27T13:25:27.956 INFO:teuthology.orchestra.run.smithi046.stdout:(121/177): libarrow-9.0.0-10.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-01-27T13:25:27.997 INFO:teuthology.orchestra.run.smithi046.stdout:(122/177): libarrow-doc-9.0.0-10.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-01-27T13:25:28.039 INFO:teuthology.orchestra.run.smithi046.stdout:(123/177): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-01-27T13:25:28.081 INFO:teuthology.orchestra.run.smithi046.stdout:(124/177): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-01-27T13:25:28.123 INFO:teuthology.orchestra.run.smithi046.stdout:(125/177): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-01-27T13:25:28.174 INFO:teuthology.orchestra.run.smithi046.stdout:(126/177): parquet-libs-9.0.0-10.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2024-01-27T13:25:28.215 INFO:teuthology.orchestra.run.smithi046.stdout:(127/177): python3-asyncssh-2.13.2-3.el9.noarch 13 MB/s | 548 kB 00:00 2024-01-27T13:25:28.257 INFO:teuthology.orchestra.run.smithi046.stdout:(128/177): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-01-27T13:25:28.299 INFO:teuthology.orchestra.run.smithi046.stdout:(129/177): python3-cachetools-4.2.4-1.el9.noarc 778 kB/s | 32 kB 00:00 2024-01-27T13:25:28.341 INFO:teuthology.orchestra.run.smithi046.stdout:(130/177): python3-certifi-2021.10.8-2.el9.noar 360 kB/s | 15 kB 00:00 2024-01-27T13:25:28.383 INFO:teuthology.orchestra.run.smithi046.stdout:(131/177): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-01-27T13:25:28.425 INFO:teuthology.orchestra.run.smithi046.stdout:(132/177): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-01-27T13:25:28.475 INFO:teuthology.orchestra.run.smithi046.stdout:(133/177): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-01-27T13:25:28.526 INFO:teuthology.orchestra.run.smithi046.stdout:(134/177): python3-colorama-0.4.4-12.el9.noarch 705 kB/s | 35 kB 00:00 2024-01-27T13:25:28.568 INFO:teuthology.orchestra.run.smithi046.stdout:(135/177): python3-google-auth-2.26.2-1.el9.noa 4.8 MB/s | 202 kB 00:00 2024-01-27T13:25:28.602 INFO:teuthology.orchestra.run.smithi046.stdout:(136/177): python3-jaraco-8.2.1-3.el9.noarch.rp 320 kB/s | 11 kB 00:00 2024-01-27T13:25:28.635 INFO:teuthology.orchestra.run.smithi046.stdout:(137/177): python3-jaraco-classes-3.2.1-5.el9.n 533 kB/s | 18 kB 00:00 2024-01-27T13:25:28.669 INFO:teuthology.orchestra.run.smithi046.stdout:(138/177): python3-jaraco-collections-3.0.0-8.e 699 kB/s | 23 kB 00:00 2024-01-27T13:25:28.703 INFO:teuthology.orchestra.run.smithi046.stdout:(139/177): python3-jaraco-functools-3.5.0-2.el9 587 kB/s | 19 kB 00:00 2024-01-27T13:25:28.736 INFO:teuthology.orchestra.run.smithi046.stdout:(140/177): python3-jaraco-text-3.2.0-6.el9.noar 595 kB/s | 20 kB 00:00 2024-01-27T13:25:28.811 INFO:teuthology.orchestra.run.smithi046.stdout:(141/177): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-01-27T13:25:28.845 INFO:teuthology.orchestra.run.smithi046.stdout:(142/177): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-01-27T13:25:28.887 INFO:teuthology.orchestra.run.smithi046.stdout:(143/177): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-01-27T13:25:28.920 INFO:teuthology.orchestra.run.smithi046.stdout:(144/177): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-01-27T13:25:28.962 INFO:teuthology.orchestra.run.smithi046.stdout:(145/177): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-01-27T13:25:28.996 INFO:teuthology.orchestra.run.smithi046.stdout:(146/177): python3-portend-3.1.0-2.el9.noarch.r 496 kB/s | 16 kB 00:00 2024-01-27T13:25:29.038 INFO:teuthology.orchestra.run.smithi046.stdout:(147/177): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-01-27T13:25:29.072 INFO:teuthology.orchestra.run.smithi046.stdout:(148/177): python3-pyperclip-1.8.2-2.el9.noarch 848 kB/s | 28 kB 00:00 2024-01-27T13:25:29.105 INFO:teuthology.orchestra.run.smithi046.stdout:(149/177): python3-repoze-lru-0.7-16.el9.noarch 929 kB/s | 31 kB 00:00 2024-01-27T13:25:29.147 INFO:teuthology.orchestra.run.smithi046.stdout:(150/177): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-01-27T13:25:29.181 INFO:teuthology.orchestra.run.smithi046.stdout:(151/177): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-01-27T13:25:29.214 INFO:teuthology.orchestra.run.smithi046.stdout:(152/177): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-01-27T13:25:29.248 INFO:teuthology.orchestra.run.smithi046.stdout:(153/177): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-01-27T13:25:29.298 INFO:teuthology.orchestra.run.smithi046.stdout:(154/177): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-01-27T13:25:29.340 INFO:teuthology.orchestra.run.smithi046.stdout:(155/177): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-01-27T13:25:29.382 INFO:teuthology.orchestra.run.smithi046.stdout:(156/177): python3-werkzeug-2.0.3-3.el9.1.noarc 10 MB/s | 427 kB 00:00 2024-01-27T13:25:29.416 INFO:teuthology.orchestra.run.smithi046.stdout:(157/177): python3-zc-lockfile-2.0-10.el9.noarc 599 kB/s | 20 kB 00:00 2024-01-27T13:25:29.458 INFO:teuthology.orchestra.run.smithi046.stdout:(158/177): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-01-27T13:25:29.516 INFO:teuthology.orchestra.run.smithi046.stdout:(159/177): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-01-27T13:25:30.775 INFO:teuthology.orchestra.run.smithi046.stdout:(160/177): librados2-19.0.0-880.g99a21c3b.el9.x 2.7 MB/s | 3.4 MB 00:01 2024-01-27T13:25:31.891 INFO:teuthology.orchestra.run.smithi046.stdout:(161/177): librbd1-19.0.0-880.g99a21c3b.el9.x86 2.8 MB/s | 3.1 MB 00:01 2024-01-27T13:25:31.925 INFO:teuthology.orchestra.run.smithi046.stdout:(162/177): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-01-27T13:25:32.050 INFO:teuthology.orchestra.run.smithi046.stdout:(163/177): NetworkManager-1.45.10-1.el9.x86_64. 18 MB/s | 2.2 MB 00:00 2024-01-27T13:25:32.159 INFO:teuthology.orchestra.run.smithi046.stdout:(164/177): NetworkManager-libnm-1.45.10-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-01-27T13:25:32.201 INFO:teuthology.orchestra.run.smithi046.stdout:(165/177): NetworkManager-team-1.45.10-1.el9.x8 1.0 MB/s | 42 kB 00:00 2024-01-27T13:25:32.243 INFO:teuthology.orchestra.run.smithi046.stdout:(166/177): NetworkManager-tui-1.45.10-1.el9.x86 5.8 MB/s | 246 kB 00:00 2024-01-27T13:25:32.277 INFO:teuthology.orchestra.run.smithi046.stdout:(167/177): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-01-27T13:25:32.310 INFO:teuthology.orchestra.run.smithi046.stdout:(168/177): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 35 kB 00:00 2024-01-27T13:25:32.352 INFO:teuthology.orchestra.run.smithi046.stdout:(169/177): elfutils-libelf-0.190-2.el9.x86_64.r 4.5 MB/s | 191 kB 00:00 2024-01-27T13:25:32.394 INFO:teuthology.orchestra.run.smithi046.stdout:(170/177): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2024-01-27T13:25:32.428 INFO:teuthology.orchestra.run.smithi046.stdout:(171/177): libacl-2.3.1-4.el9.x86_64.rpm 660 kB/s | 22 kB 00:00 2024-01-27T13:25:32.503 INFO:teuthology.orchestra.run.smithi046.stdout:(172/177): openssl-3.0.7-25.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-01-27T13:25:32.620 INFO:teuthology.orchestra.run.smithi046.stdout:(173/177): openssl-libs-3.0.7-25.el9.x86_64.rpm 18 MB/s | 2.1 MB 00:00 2024-01-27T13:25:32.670 INFO:teuthology.orchestra.run.smithi046.stdout:(174/177): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-01-27T13:25:32.754 INFO:teuthology.orchestra.run.smithi046.stdout:(175/177): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-27T13:25:37.904 INFO:teuthology.orchestra.run.smithi046.stdout:(176/177): ceph-test-debuginfo-19.0.0-880.g99a2 8.2 MB/s | 664 MB 01:21 2024-01-27T13:25:45.178 INFO:teuthology.orchestra.run.smithi046.stdout:(177/177): ceph-osd-debuginfo-19.0.0-880.g99a21 2.4 MB/s | 286 MB 01:57 2024-01-27T13:25:45.183 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-01-27T13:25:45.183 INFO:teuthology.orchestra.run.smithi046.stdout:Total 13 MB/s | 2.1 GB 02:40 2024-01-27T13:25:45.217 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-01-27T13:25:45.521 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-01-27T13:25:45.521 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-01-27T13:25:59.417 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-01-27T13:25:59.417 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-01-27T13:26:16.183 INFO:teuthology.orchestra.run.smithi078.stdout:(177/177): ceph-test-debuginfo-19.0.0-880.g99a2 5.9 MB/s | 664 MB 01:53 2024-01-27T13:26:16.189 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-01-27T13:26:16.189 INFO:teuthology.orchestra.run.smithi078.stdout:Total 11 MB/s | 2.1 GB 03:16 2024-01-27T13:26:16.223 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-01-27T13:26:16.513 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-01-27T13:26:16.513 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-01-27T13:26:20.644 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-01-27T13:26:20.911 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T13:26:20.979 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/193 2024-01-27T13:26:21.027 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/193 2024-01-27T13:26:21.082 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/193 2024-01-27T13:26:21.123 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/193 2024-01-27T13:26:21.147 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/193 2024-01-27T13:26:21.202 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/193 2024-01-27T13:26:21.540 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/193 2024-01-27T13:26:21.581 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T13:26:21.705 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T13:26:21.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T13:26:21.833 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T13:26:21.870 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T13:26:21.967 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/193 2024-01-27T13:26:22.061 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 13/193 2024-01-27T13:26:22.257 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/193 2024-01-27T13:26:22.312 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/193 2024-01-27T13:26:22.338 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T13:26:22.443 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T13:26:22.473 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T13:26:22.535 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T13:26:22.703 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/193 2024-01-27T13:26:22.826 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T13:26:22.870 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T13:26:22.995 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T13:26:23.046 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T13:26:23.322 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T13:26:23.359 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/193 2024-01-27T13:26:23.431 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/193 2024-01-27T13:26:23.483 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 23/193 2024-01-27T13:26:23.521 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 24/193 2024-01-27T13:26:23.583 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/193 2024-01-27T13:26:23.622 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/193 2024-01-27T13:26:23.697 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 27/193 2024-01-27T13:26:23.737 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 28/193 2024-01-27T13:26:23.779 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 29/193 2024-01-27T13:26:23.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/193 2024-01-27T13:26:23.887 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/193 2024-01-27T13:26:23.928 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T13:26:23.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 33/193 2024-01-27T13:26:24.000 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 34/193 2024-01-27T13:26:24.072 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/193 2024-01-27T13:26:24.158 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/193 2024-01-27T13:26:24.301 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/193 2024-01-27T13:26:24.360 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/193 2024-01-27T13:26:24.946 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/193 2024-01-27T13:26:25.033 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/193 2024-01-27T13:26:25.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 41/193 2024-01-27T13:26:25.118 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/193 2024-01-27T13:26:25.147 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 43/193 2024-01-27T13:26:25.190 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/193 2024-01-27T13:26:25.329 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/193 2024-01-27T13:26:25.382 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 46/193 2024-01-27T13:26:25.492 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-3.el9.x86_64 47/193 2024-01-27T13:26:25.527 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 48/193 2024-01-27T13:26:25.585 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/193 2024-01-27T13:26:25.659 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/193 2024-01-27T13:26:25.694 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/193 2024-01-27T13:26:25.731 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/193 2024-01-27T13:26:25.779 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/193 2024-01-27T13:26:25.814 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/193 2024-01-27T13:26:25.858 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/193 2024-01-27T13:26:25.900 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/193 2024-01-27T13:26:26.047 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/193 2024-01-27T13:26:26.088 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/193 2024-01-27T13:26:26.185 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/193 2024-01-27T13:26:26.447 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/193 2024-01-27T13:26:26.742 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/193 2024-01-27T13:26:26.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 62/193 2024-01-27T13:26:26.995 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/193 2024-01-27T13:26:27.025 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/193 2024-01-27T13:26:27.139 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 65/193 2024-01-27T13:26:27.196 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 66/193 2024-01-27T13:26:27.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/193 2024-01-27T13:26:27.319 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/193 2024-01-27T13:26:27.527 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/193 2024-01-27T13:26:27.566 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 70/193 2024-01-27T13:26:27.723 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/193 2024-01-27T13:26:27.764 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 72/193 2024-01-27T13:26:27.796 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 73/193 2024-01-27T13:26:27.828 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 74/193 2024-01-27T13:26:27.863 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : jq-1.6-16.el9.x86_64 75/193 2024-01-27T13:26:27.902 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-15.el9.x86_64 76/193 2024-01-27T13:26:27.930 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 77/193 2024-01-27T13:26:27.971 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 78/193 2024-01-27T13:26:28.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 79/193 2024-01-27T13:26:28.053 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 80/193 2024-01-27T13:26:28.082 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/193 2024-01-27T13:26:28.163 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/193 2024-01-27T13:26:28.193 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/193 2024-01-27T13:26:28.217 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/193 2024-01-27T13:26:28.252 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/193 2024-01-27T13:26:28.285 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/193 2024-01-27T13:26:28.380 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/193 2024-01-27T13:26:28.412 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/193 2024-01-27T13:26:28.524 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/193 2024-01-27T13:26:28.574 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/193 2024-01-27T13:26:29.386 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/193 2024-01-27T13:26:29.444 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/193 2024-01-27T13:26:29.477 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/193 2024-01-27T13:26:29.528 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/193 2024-01-27T13:26:29.621 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/193 2024-01-27T13:26:29.653 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/193 2024-01-27T13:26:29.830 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.21-2.el9.x86_64 97/193 2024-01-27T13:26:29.851 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 98/193 2024-01-27T13:26:29.857 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-01-27T13:26:29.858 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-01-27T13:26:29.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/193 2024-01-27T13:26:30.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/193 2024-01-27T13:26:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/193 2024-01-27T13:26:32.109 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/193 2024-01-27T13:26:32.181 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/193 2024-01-27T13:26:32.210 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/193 2024-01-27T13:26:32.242 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/193 2024-01-27T13:26:32.567 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/193 2024-01-27T13:26:32.589 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T13:26:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T13:26:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 108/193 2024-01-27T13:26:32.747 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/193 2024-01-27T13:26:33.190 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/193 2024-01-27T13:26:33.225 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T13:26:33.317 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T13:26:33.343 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 112/193 2024-01-27T13:26:35.530 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T13:26:35.565 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T13:26:36.107 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T13:26:36.143 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T13:26:36.233 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T13:26:36.233 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-27T13:26:36.233 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-27T13:26:36.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:36.261 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-01-27T13:26:48.075 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-01-27T13:26:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T13:26:48.256 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T13:26:48.256 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:48.257 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-27T13:26:48.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:49.769 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T13:26:49.795 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T13:26:49.795 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:49.795 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-27T13:26:49.795 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T13:26:49.795 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T13:26:49.795 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:50.020 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T13:26:50.048 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T13:26:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-27T13:26:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T13:26:50.048 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T13:26:50.049 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:50.268 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-01-27T13:26:50.473 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T13:26:50.531 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T13:26:50.550 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/193 2024-01-27T13:26:50.553 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T13:26:50.553 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:50.553 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-27T13:26:50.554 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T13:26:50.554 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T13:26:50.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:50.596 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/193 2024-01-27T13:26:50.641 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 120/193 2024-01-27T13:26:50.652 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/193 2024-01-27T13:26:50.684 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/193 2024-01-27T13:26:50.710 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/193 2024-01-27T13:26:50.770 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/193 2024-01-27T13:26:51.047 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T13:26:51.073 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T13:26:51.103 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/193 2024-01-27T13:26:51.104 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 122/193 2024-01-27T13:26:51.152 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T13:26:51.166 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 123/193 2024-01-27T13:26:51.196 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T13:26:51.273 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 9/193 2024-01-27T13:26:51.303 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T13:26:51.395 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 10/193 2024-01-27T13:26:51.427 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T13:26:51.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T13:26:51.455 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T13:26:51.520 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/193 2024-01-27T13:26:51.625 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 13/193 2024-01-27T13:26:51.815 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/193 2024-01-27T13:26:51.866 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/193 2024-01-27T13:26:51.893 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T13:26:51.997 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 16/193 2024-01-27T13:26:52.019 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T13:26:52.072 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 17/193 2024-01-27T13:26:52.216 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/193 2024-01-27T13:26:52.376 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T13:26:52.467 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T13:26:52.489 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T13:26:52.595 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T13:26:52.665 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 19/193 2024-01-27T13:26:52.759 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 127/193 2024-01-27T13:26:52.783 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T13:26:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T13:26:52.805 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T13:26:52.805 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-27T13:26:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T13:26:52.806 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T13:26:52.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:52.843 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T13:26:52.850 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T13:26:52.860 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T13:26:52.914 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 130/193 2024-01-27T13:26:53.118 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 20/193 2024-01-27T13:26:53.147 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/193 2024-01-27T13:26:53.216 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/193 2024-01-27T13:26:53.278 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 23/193 2024-01-27T13:26:53.309 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 24/193 2024-01-27T13:26:53.352 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/193 2024-01-27T13:26:53.392 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/193 2024-01-27T13:26:53.465 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 27/193 2024-01-27T13:26:53.500 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 28/193 2024-01-27T13:26:53.533 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 29/193 2024-01-27T13:26:53.561 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/193 2024-01-27T13:26:53.632 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/193 2024-01-27T13:26:53.666 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T13:26:53.709 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 33/193 2024-01-27T13:26:53.743 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/193 2024-01-27T13:26:53.746 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 34/193 2024-01-27T13:26:53.769 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T13:26:53.791 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T13:26:53.791 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:53.791 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-27T13:26:53.791 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T13:26:53.791 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T13:26:53.791 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:53.817 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/193 2024-01-27T13:26:53.837 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T13:26:53.858 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T13:26:53.858 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:53.858 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-27T13:26:53.858 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:53.893 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/193 2024-01-27T13:26:53.912 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T13:26:53.934 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T13:26:53.934 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:53.934 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-27T13:26:53.934 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T13:26:53.935 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T13:26:53.935 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:54.030 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/193 2024-01-27T13:26:54.080 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/193 2024-01-27T13:26:54.255 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T13:26:54.276 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T13:26:54.277 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:26:54.277 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-27T13:26:54.277 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T13:26:54.277 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T13:26:54.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:26:54.635 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/193 2024-01-27T13:26:54.718 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/193 2024-01-27T13:26:54.749 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 41/193 2024-01-27T13:26:54.797 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/193 2024-01-27T13:26:54.835 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 43/193 2024-01-27T13:26:54.877 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/193 2024-01-27T13:26:55.026 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/193 2024-01-27T13:26:55.060 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 46/193 2024-01-27T13:26:55.168 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-3.el9.x86_64 47/193 2024-01-27T13:26:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 48/193 2024-01-27T13:26:55.260 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/193 2024-01-27T13:26:55.335 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/193 2024-01-27T13:26:55.381 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/193 2024-01-27T13:26:55.418 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/193 2024-01-27T13:26:55.464 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/193 2024-01-27T13:26:55.500 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/193 2024-01-27T13:26:55.543 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/193 2024-01-27T13:26:55.585 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/193 2024-01-27T13:26:55.723 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/193 2024-01-27T13:26:55.807 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/193 2024-01-27T13:26:55.838 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/193 2024-01-27T13:26:55.879 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/193 2024-01-27T13:26:55.976 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/193 2024-01-27T13:26:56.020 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 62/193 2024-01-27T13:26:56.060 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/193 2024-01-27T13:26:56.086 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/193 2024-01-27T13:26:56.182 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 65/193 2024-01-27T13:26:56.221 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 66/193 2024-01-27T13:26:56.271 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/193 2024-01-27T13:26:56.326 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/193 2024-01-27T13:26:56.525 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/193 2024-01-27T13:26:56.567 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 70/193 2024-01-27T13:26:56.707 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/193 2024-01-27T13:26:56.757 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 72/193 2024-01-27T13:26:56.789 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 73/193 2024-01-27T13:26:56.821 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 74/193 2024-01-27T13:26:56.861 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : jq-1.6-16.el9.x86_64 75/193 2024-01-27T13:26:56.896 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-15.el9.x86_64 76/193 2024-01-27T13:26:56.924 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 77/193 2024-01-27T13:26:56.966 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 78/193 2024-01-27T13:26:57.005 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 79/193 2024-01-27T13:26:57.037 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 80/193 2024-01-27T13:26:57.067 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/193 2024-01-27T13:26:57.145 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/193 2024-01-27T13:26:57.177 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/193 2024-01-27T13:26:57.227 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/193 2024-01-27T13:26:57.268 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/193 2024-01-27T13:26:57.303 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/193 2024-01-27T13:26:57.395 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/193 2024-01-27T13:26:57.433 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/193 2024-01-27T13:26:57.536 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/193 2024-01-27T13:26:57.593 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 90/193 2024-01-27T13:26:58.337 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/193 2024-01-27T13:26:58.389 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 92/193 2024-01-27T13:26:58.431 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 93/193 2024-01-27T13:26:58.480 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 94/193 2024-01-27T13:26:58.571 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 95/193 2024-01-27T13:26:58.607 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 96/193 2024-01-27T13:26:58.784 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.21-2.el9.x86_64 97/193 2024-01-27T13:26:58.813 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 98/193 2024-01-27T13:26:58.825 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 136/193 2024-01-27T13:26:58.867 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 137/193 2024-01-27T13:26:58.891 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 99/193 2024-01-27T13:26:58.916 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 138/193 2024-01-27T13:26:58.956 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/193 2024-01-27T13:26:58.992 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/193 2024-01-27T13:26:59.204 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 141/193 2024-01-27T13:26:59.328 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/193 2024-01-27T13:26:59.364 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 143/193 2024-01-27T13:26:59.396 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 144/193 2024-01-27T13:26:59.437 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 145/193 2024-01-27T13:26:59.467 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 146/193 2024-01-27T13:26:59.536 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 147/193 2024-01-27T13:26:59.607 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/193 2024-01-27T13:26:59.613 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 100/193 2024-01-27T13:26:59.640 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/193 2024-01-27T13:26:59.730 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 101/193 2024-01-27T13:27:00.264 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T13:27:00.306 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T13:27:00.339 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T13:27:00.395 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/193 2024-01-27T13:27:01.002 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 102/193 2024-01-27T13:27:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 103/193 2024-01-27T13:27:01.111 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 104/193 2024-01-27T13:27:01.144 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 105/193 2024-01-27T13:27:01.284 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 152/193 2024-01-27T13:27:01.459 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/193 2024-01-27T13:27:01.504 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T13:27:01.572 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 107/193 2024-01-27T13:27:01.603 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 108/193 2024-01-27T13:27:01.640 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/193 2024-01-27T13:27:02.070 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/193 2024-01-27T13:27:02.093 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T13:27:02.164 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 111/193 2024-01-27T13:27:02.186 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 112/193 2024-01-27T13:27:04.220 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T13:27:04.258 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T13:27:04.787 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 113/193 2024-01-27T13:27:04.820 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T13:27:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 114/193 2024-01-27T13:27:04.899 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-27T13:27:04.899 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-27T13:27:04.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:04.938 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T13:27:08.650 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 153/193 2024-01-27T13:27:17.053 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 115/193 2024-01-27T13:27:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-01-27T13:27:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-01-27T13:27:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-01-27T13:27:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-01-27T13:27:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-01-27T13:27:17.054 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-01-27T13:27:17.055 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-01-27T13:27:17.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:17.225 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T13:27:17.240 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 116/193 2024-01-27T13:27:17.240 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:17.240 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-27T13:27:17.240 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:18.703 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T13:27:18.728 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 117/193 2024-01-27T13:27:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-27T13:27:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T13:27:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-27T13:27:18.729 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:18.946 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T13:27:18.968 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 118/193 2024-01-27T13:27:18.968 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:18.968 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-27T13:27:18.968 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T13:27:18.968 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-27T13:27:18.968 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:19.413 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T13:27:19.435 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 119/193 2024-01-27T13:27:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-27T13:27:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T13:27:19.435 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-27T13:27:19.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:19.523 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.2-8.el9.noarch 120/193 2024-01-27T13:27:19.978 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T13:27:20.004 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 121/193 2024-01-27T13:27:20.035 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 122/193 2024-01-27T13:27:20.095 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 123/193 2024-01-27T13:27:20.120 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T13:27:20.341 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 124/193 2024-01-27T13:27:20.370 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T13:27:21.336 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 125/193 2024-01-27T13:27:21.362 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T13:27:21.460 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 126/193 2024-01-27T13:27:21.625 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 127/193 2024-01-27T13:27:21.656 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T13:27:21.679 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 128/193 2024-01-27T13:27:21.679 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:21.679 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-27T13:27:21.679 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T13:27:21.679 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-27T13:27:21.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:21.724 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T13:27:21.734 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 129/193 2024-01-27T13:27:21.788 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 130/193 2024-01-27T13:27:22.573 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/193 2024-01-27T13:27:22.601 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T13:27:22.623 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 132/193 2024-01-27T13:27:22.623 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:22.623 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-27T13:27:22.623 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T13:27:22.623 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-27T13:27:22.623 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:22.676 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T13:27:22.697 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-880.g99a21c 133/193 2024-01-27T13:27:22.697 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:22.697 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-27T13:27:22.697 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:22.752 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T13:27:22.774 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 134/193 2024-01-27T13:27:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-27T13:27:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T13:27:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-27T13:27:22.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:23.077 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T13:27:23.100 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 135/193 2024-01-27T13:27:23.100 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-27T13:27:23.100 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-27T13:27:23.100 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T13:27:23.100 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-27T13:27:23.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:27:27.398 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 136/193 2024-01-27T13:27:27.447 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 137/193 2024-01-27T13:27:27.497 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 138/193 2024-01-27T13:27:27.537 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 139/193 2024-01-27T13:27:27.572 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 140/193 2024-01-27T13:27:27.777 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 141/193 2024-01-27T13:27:27.905 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 142/193 2024-01-27T13:27:27.936 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 143/193 2024-01-27T13:27:27.977 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 144/193 2024-01-27T13:27:28.018 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 145/193 2024-01-27T13:27:28.047 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 146/193 2024-01-27T13:27:28.120 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 147/193 2024-01-27T13:27:28.199 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 148/193 2024-01-27T13:27:28.230 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/193 2024-01-27T13:27:28.871 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T13:27:28.912 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T13:27:28.949 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 150/193 2024-01-27T13:27:29.018 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/193 2024-01-27T13:27:29.823 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 152/193 2024-01-27T13:27:36.790 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 153/193 2024-01-27T13:27:50.166 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 154/193 2024-01-27T13:27:50.826 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 155/193 2024-01-27T13:27:51.387 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 156/193 2024-01-27T13:27:56.306 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 157/193 2024-01-27T13:27:58.455 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 158/193 2024-01-27T13:28:08.879 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 159/193 2024-01-27T13:28:16.051 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 154/193 2024-01-27T13:28:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 155/193 2024-01-27T13:28:16.833 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 156/193 2024-01-27T13:28:21.205 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 157/193 2024-01-27T13:28:23.514 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 158/193 2024-01-27T13:28:33.466 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 159/193 2024-01-27T13:28:38.097 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 160/193 2024-01-27T13:28:55.511 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 161/193 2024-01-27T13:29:01.214 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 160/193 2024-01-27T13:29:17.580 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 161/193 2024-01-27T13:30:05.733 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 162/193 2024-01-27T13:30:06.313 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 163/193 2024-01-27T13:30:06.353 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 164/193 2024-01-27T13:30:11.306 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 165/193 2024-01-27T13:30:17.247 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 166/193 2024-01-27T13:30:17.662 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 167/193 2024-01-27T13:30:17.878 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 168/193 2024-01-27T13:30:18.023 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 169/193 2024-01-27T13:30:18.084 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 170/193 2024-01-27T13:30:18.165 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 171/193 2024-01-27T13:30:23.649 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 162/193 2024-01-27T13:30:24.035 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 172/193 2024-01-27T13:30:24.209 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 163/193 2024-01-27T13:30:24.469 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 173/193 2024-01-27T13:30:24.516 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 164/193 2024-01-27T13:30:24.730 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 174/193 2024-01-27T13:30:25.269 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/193 2024-01-27T13:30:25.373 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/193 2024-01-27T13:30:25.409 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/193 2024-01-27T13:30:25.434 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/193 2024-01-27T13:30:25.460 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T13:30:25.486 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/193 2024-01-27T13:30:25.487 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T13:30:25.579 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T13:30:25.608 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/193 2024-01-27T13:30:25.663 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/193 2024-01-27T13:30:25.696 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/193 2024-01-27T13:30:25.722 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 185/193 2024-01-27T13:30:25.722 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T13:30:25.807 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T13:30:25.831 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 187/193 2024-01-27T13:30:25.838 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T13:30:25.839 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T13:30:26.026 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T13:30:26.026 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T13:30:26.118 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T13:30:26.150 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 190/193 2024-01-27T13:30:26.181 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 191/193 2024-01-27T13:30:26.210 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 192/193 2024-01-27T13:30:26.279 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T13:30:29.435 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 165/193 2024-01-27T13:30:35.140 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 3/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 4/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 5/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 6/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 7/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 8/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 9/193 2024-01-27T13:30:35.141 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 10/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 12/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 13/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 14/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 15/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 16/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 17/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 18/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 19/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 20/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 21/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 22/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 23/193 2024-01-27T13:30:35.142 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 24/193 2024-01-27T13:30:35.143 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 25/193 2024-01-27T13:30:35.143 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 26/193 2024-01-27T13:30:35.143 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 27/193 2024-01-27T13:30:35.144 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 166/193 2024-01-27T13:30:35.160 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 28/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 29/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 30/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 31/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 33/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 34/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 35/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 36/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 37/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 38/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 39/193 2024-01-27T13:30:35.161 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 40/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 41/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 42/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 43/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 44/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 45/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 46/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 47/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 48/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 49/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 50/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 51/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 52/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 53/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 54/193 2024-01-27T13:30:35.162 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 55/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 56/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 57/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 58/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 59/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 60/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 61/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/193 2024-01-27T13:30:35.163 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/193 2024-01-27T13:30:35.164 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 81/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 86/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 87/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 88/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 89/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 90/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 91/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 92/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 93/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 95/193 2024-01-27T13:30:35.165 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 96/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 106/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 108/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 109/193 2024-01-27T13:30:35.166 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : jq-1.6-16.el9.x86_64 110/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 111/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 112/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 113/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 114/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 115/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 116/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 117/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 118/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 119/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 121/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 122/193 2024-01-27T13:30:35.167 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 123/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 124/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 125/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 127/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 128/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 129/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 130/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 131/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 132/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 133/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 134/193 2024-01-27T13:30:35.168 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 135/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 136/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 137/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 138/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 139/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 140/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 141/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 142/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 143/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 144/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 145/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 146/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 147/193 2024-01-27T13:30:35.169 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 148/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 149/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 150/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 151/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 152/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 153/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 154/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 155/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 156/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 158/193 2024-01-27T13:30:35.170 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-3.el9.x86_64 160/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 161/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 162/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 163/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 164/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 165/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 166/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 167/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 168/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 169/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 170/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 171/193 2024-01-27T13:30:35.171 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 172/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 174/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-4.el9.x86_64 176/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : acl-2.3.1-3.el9.x86_64 177/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 178/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 180/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 181/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 182/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 183/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 184/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 185/193 2024-01-27T13:30:35.172 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 186/193 2024-01-27T13:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 187/193 2024-01-27T13:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 188/193 2024-01-27T13:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 189/193 2024-01-27T13:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 190/193 2024-01-27T13:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 191/193 2024-01-27T13:30:35.173 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 192/193 2024-01-27T13:30:35.321 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 167/193 2024-01-27T13:30:35.418 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 168/193 2024-01-27T13:30:35.555 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 169/193 2024-01-27T13:30:35.611 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 170/193 2024-01-27T13:30:35.692 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 171/193 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 193/193 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:38.390 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: acl-2.3.1-4.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-27T13:30:38.391 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.392 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.393 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-27T13:30:38.394 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: jq-1.6-16.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-27T13:30:38.395 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-27T13:30:38.396 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.11-1.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-27T13:30:38.397 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-27T13:30:38.398 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-27T13:30:38.399 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-27T13:30:38.400 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-27T13:30:38.401 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-27T13:30:38.402 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-3.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-27T13:30:38.403 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-27T13:30:38.404 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-27T13:30:38.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:30:38.404 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-01-27T13:30:39.044 DEBUG:teuthology.parallel:result is None 2024-01-27T13:30:41.309 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 172/193 2024-01-27T13:30:41.715 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 173/193 2024-01-27T13:30:42.018 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 174/193 2024-01-27T13:30:42.738 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 175/193 2024-01-27T13:30:42.847 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.4-9.el9.x86_64 176/193 2024-01-27T13:30:42.889 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.7.4-5.el9.x86_64 177/193 2024-01-27T13:30:42.914 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 178/193 2024-01-27T13:30:42.939 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T13:30:42.965 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 180/193 2024-01-27T13:30:42.966 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T13:30:43.050 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 181/193 2024-01-27T13:30:43.078 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 182/193 2024-01-27T13:30:43.126 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 183/193 2024-01-27T13:30:43.159 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/193 2024-01-27T13:30:43.192 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 185/193 2024-01-27T13:30:43.193 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T13:30:43.277 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 186/193 2024-01-27T13:30:43.302 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 187/193 2024-01-27T13:30:43.314 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T13:30:43.314 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T13:30:43.496 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 188/193 2024-01-27T13:30:43.497 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T13:30:43.615 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 189/193 2024-01-27T13:30:43.646 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 190/193 2024-01-27T13:30:43.700 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 191/193 2024-01-27T13:30:43.739 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 192/193 2024-01-27T13:30:43.823 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T13:30:52.767 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 193/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 1/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 3/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 4/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9 5/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 6/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 7/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 8/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-880.g99a21c 9/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-8 10/193 2024-01-27T13:30:52.768 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 11/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 12/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 13/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 14/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 15/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 16/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 17/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 18/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 19/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el 20/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 21/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 22/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 23/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 24/193 2024-01-27T13:30:52.769 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 25/193 2024-01-27T13:30:52.770 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_6 26/193 2024-01-27T13:30:52.770 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 27/193 2024-01-27T13:30:52.770 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9. 28/193 2024-01-27T13:30:52.770 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 29/193 2024-01-27T13:30:52.785 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 30/193 2024-01-27T13:30:52.785 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-880.g99a21c3b. 31/193 2024-01-27T13:30:52.785 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x 32/193 2024-01-27T13:30:52.785 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_ 33/193 2024-01-27T13:30:52.785 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 34/193 2024-01-27T13:30:52.785 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 35/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9 36/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x 37/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 38/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b. 39/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 40/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.e 41/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 42/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9 43/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 44/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9 45/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 46/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x8 47/193 2024-01-27T13:30:52.786 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 48/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9. 49/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 50/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86 51/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.e 52/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noar 53/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.no 54/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-880.g99a2 55/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9 56/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 57/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el 58/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 59/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 60/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 61/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/193 2024-01-27T13:30:52.787 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 65/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 66/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 67/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 68/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 69/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/193 2024-01-27T13:30:52.788 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 79/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 80/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 81/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 86/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 87/193 2024-01-27T13:30:52.789 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 88/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 89/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 90/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 91/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 92/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 93/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 95/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 96/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/193 2024-01-27T13:30:52.790 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 106/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 107/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 108/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 109/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : jq-1.6-16.el9.x86_64 110/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 111/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 112/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 113/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 114/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 115/193 2024-01-27T13:30:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 116/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 117/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 118/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 119/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 120/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 121/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 122/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 123/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 124/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 125/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 126/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 127/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 128/193 2024-01-27T13:30:52.792 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 129/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 130/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 131/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 132/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 133/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 134/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 135/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 136/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 137/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 138/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 139/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 140/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 141/193 2024-01-27T13:30:52.793 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 142/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 143/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 144/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 145/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 146/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 147/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 148/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 149/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 150/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 151/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 152/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 153/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 154/193 2024-01-27T13:30:52.794 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 155/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 156/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 158/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-3.el9.x86_64 160/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 161/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 162/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 163/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 164/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 165/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 166/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 167/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 168/193 2024-01-27T13:30:52.795 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 169/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 170/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 171/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 172/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 174/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : acl-2.3.1-4.el9.x86_64 176/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : acl-2.3.1-3.el9.x86_64 177/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 178/193 2024-01-27T13:30:52.796 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 179/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 180/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 181/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 182/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 183/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 184/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 185/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 186/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 187/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 188/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 189/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 190/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 191/193 2024-01-27T13:30:52.797 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 192/193 2024-01-27T13:30:55.895 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 193/193 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: acl-2.3.1-4.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-27T13:30:55.896 INFO:teuthology.orchestra.run.smithi078.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.2-8.el9.noarch 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.7.4-5.el9.x86_64 2024-01-27T13:30:55.897 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.898 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.899 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:19.0.0-880.g99a21c3b.el9.noarch 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.4-9.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-27T13:30:55.900 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: jq-1.6-16.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-27T13:30:55.901 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-27T13:30:55.902 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-13.11-1.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-27T13:30:55.903 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-27T13:30:55.904 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-27T13:30:55.905 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-27T13:30:55.906 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.907 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-27T13:30:55.908 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-debuginfo-2:19.0.0-880.g99a21c3b.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-3.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-27T13:30:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-27T13:30:55.911 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-27T13:30:55.911 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:30:55.911 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-01-27T13:30:56.520 DEBUG:teuthology.parallel:result is None 2024-01-27T13:30:56.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:30:56.669 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-27T13:30:56.694 INFO:teuthology.orchestra.run.smithi046.stdout:19.0.0-880.g99a21c3b.el9 2024-01-27T13:30:56.695 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-880.g99a21c3b.el9 2024-01-27T13:30:56.695 INFO:teuthology.task.install:The correct ceph version 19.0.0-880.g99a21c3b is installed. 2024-01-27T13:30:56.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:30:56.840 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-27T13:30:56.864 INFO:teuthology.orchestra.run.smithi078.stdout:19.0.0-880.g99a21c3b.el9 2024-01-27T13:30:56.864 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-880.g99a21c3b.el9 2024-01-27T13:30:56.864 INFO:teuthology.task.install:The correct ceph version 19.0.0-880.g99a21c3b is installed. 2024-01-27T13:30:56.867 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-27T13:30:56.867 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:56.867 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-27T13:30:56.902 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:30:56.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-27T13:30:56.934 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-27T13:30:56.934 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:56.935 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-01-27T13:30:56.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-27T13:30:57.040 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:30:57.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-01-27T13:30:57.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-27T13:30:57.135 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-27T13:30:57.136 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:57.136 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-27T13:30:57.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-27T13:30:57.232 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:30:57.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-27T13:30:57.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-27T13:30:57.326 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-27T13:30:57.327 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:57.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-01-27T13:30:57.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-27T13:30:57.421 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:30:57.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-01-27T13:30:57.448 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-27T13:30:57.515 INFO:teuthology.run_tasks:Running task ceph... 2024-01-27T13:30:57.596 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-27T13:30:57.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /var/log/ceph 2024-01-27T13:30:57.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-01-27T13:30:57.625 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-27T13:30:57.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-27T13:30:57.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-27T13:30:57.692 INFO:tasks.ceph:Creating extra log directories... 2024-01-27T13:30:57.692 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-27T13:30:57.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-27T13:30:57.765 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-27T13:30:57.765 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-27T13:30:57.765 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-27T13:30:57.765 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:57.765 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-27T13:30:57.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-27T13:30:57.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-27T13:30:57.956 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:30:57.956 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-27T13:30:57.971 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-27T13:30:58.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-27T13:30:58.122 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-27T13:30:58.122 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-27T13:30:58.122 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7534443', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4613, 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSiUJLD7NupzrbLNMQlJkAwwNfMl33iRfrA6vxAJLhAVxjq3Ty5GbVp6DlyXBbJp/VdpttpZSFScR0DKKRdIv8=', 'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAM43CzzKNHAgRaevX71/zsxlDd9gm3zQ//qqeybgcK1bd5MV8ACud4PV6AJPCj8K49YmP2/mjYFQEgbCuxvt1Q='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c856e0f9244dd29a50697123b480d63f16a4ed81', 'timestamp': '2024-01-26_15:05:59', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-27T13:30:58.123 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-27T13:30:58.125 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-27T13:30:58.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m0777 -- /var/run/ceph 2024-01-27T13:30:58.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-01-27T13:30:58.239 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:58.239 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-01-27T13:30:58.258 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-27T13:30:58.258 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-01-27T13:30:58.312 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-27T13:30:58.312 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 804 Links: 1 2024-01-27T13:30:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:58.312 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:58.313 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 13:30:26.601605748 +0000 2024-01-27T13:30:58.313 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 13:22:13.162053724 +0000 2024-01-27T13:30:58.313 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 13:22:13.162053724 +0000 2024-01-27T13:30:58.313 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 13:22:13.162053724 +0000 2024-01-27T13:30:58.313 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-27T13:30:58.377 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T13:30:58.377 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T13:30:58.377 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 8.8383e-05 s, 5.8 MB/s 2024-01-27T13:30:58.378 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-27T13:30:58.433 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-01-27T13:30:58.487 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 823 Links: 1 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 13:30:26.602605739 +0000 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 13:22:13.510050480 +0000 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 13:22:13.510050480 +0000 2024-01-27T13:30:58.488 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 13:22:13.510050480 +0000 2024-01-27T13:30:58.488 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-27T13:30:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T13:30:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T13:30:58.552 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.197e-05 s, 5.6 MB/s 2024-01-27T13:30:58.553 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-27T13:30:58.610 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 841 Links: 1 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 13:30:26.602605739 +0000 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 13:22:13.855047264 +0000 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 13:22:13.855047264 +0000 2024-01-27T13:30:58.665 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 13:22:13.855047264 +0000 2024-01-27T13:30:58.665 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-27T13:30:58.731 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T13:30:58.731 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T13:30:58.731 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.2379e-05 s, 5.5 MB/s 2024-01-27T13:30:58.732 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-27T13:30:58.787 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-01-27T13:30:58.841 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-27T13:30:58.841 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 861 Links: 1 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-01-27 13:30:26.602605739 +0000 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 13:22:14.190044141 +0000 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 13:22:14.190044141 +0000 2024-01-27T13:30:58.842 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-01-27 13:22:14.190044141 +0000 2024-01-27T13:30:58.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-27T13:30:58.906 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-01-27T13:30:58.906 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-01-27T13:30:58.906 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.187e-05 s, 5.6 MB/s 2024-01-27T13:30:58.907 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-27T13:30:58.962 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T13:30:58.962 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:30:58.963 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-01-27T13:30:58.981 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-27T13:30:58.981 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-01-27 13:30:44.152150717 +0000 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-01-27 13:22:01.732700712 +0000 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-01-27 13:22:01.732700712 +0000 2024-01-27T13:30:59.039 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-01-27 13:22:01.732700712 +0000 2024-01-27T13:30:59.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-27T13:30:59.108 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-01-27T13:30:59.109 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-01-27T13:30:59.109 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000220109 s, 2.3 MB/s 2024-01-27T13:30:59.110 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-27T13:30:59.168 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-01-27 13:30:44.153150700 +0000 2024-01-27T13:30:59.225 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-01-27 13:22:02.073695027 +0000 2024-01-27T13:30:59.226 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-01-27 13:22:02.073695027 +0000 2024-01-27T13:30:59.226 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-01-27 13:22:02.073695027 +0000 2024-01-27T13:30:59.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-27T13:30:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-01-27T13:30:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-01-27T13:30:59.292 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000235485 s, 2.2 MB/s 2024-01-27T13:30:59.294 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-27T13:30:59.351 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-01-27 13:30:44.153150700 +0000 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-01-27 13:22:02.430689075 +0000 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-01-27 13:22:02.430689075 +0000 2024-01-27T13:30:59.407 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-01-27 13:22:02.430689075 +0000 2024-01-27T13:30:59.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-27T13:30:59.473 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-01-27T13:30:59.474 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-01-27T13:30:59.474 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000184656 s, 2.8 MB/s 2024-01-27T13:30:59.475 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-27T13:30:59.531 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-01-27T13:30:59.586 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-27T13:30:59.586 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-27T13:30:59.586 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-01-27T13:30:59.586 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:30:59.587 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-01-27T13:30:59.587 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-01-27 13:30:44.154150684 +0000 2024-01-27T13:30:59.587 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-01-27 13:22:02.763683523 +0000 2024-01-27T13:30:59.587 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-01-27 13:22:02.763683523 +0000 2024-01-27T13:30:59.587 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-01-27 13:22:02.763683523 +0000 2024-01-27T13:30:59.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-27T13:30:59.652 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-01-27T13:30:59.652 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-01-27T13:30:59.653 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00024933 s, 2.1 MB/s 2024-01-27T13:30:59.654 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-27T13:30:59.711 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T13:30:59.711 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-27T13:30:59.711 INFO:tasks.ceph:Generating config... 2024-01-27T13:30:59.713 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-27T13:30:59.713 INFO:tasks.ceph:[client] debug client = 20 2024-01-27T13:30:59.713 INFO:tasks.ceph:[client] debug ms = 1 2024-01-27T13:30:59.713 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-27T13:30:59.714 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-27T13:30:59.714 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-01-27T13:30:59.714 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-01-27T13:30:59.714 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-01-27T13:30:59.714 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-27T13:30:59.715 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-27T13:30:59.715 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-27T13:30:59.715 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-01-27T13:30:59.715 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-27T13:30:59.715 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-27T13:30:59.716 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-27T13:30:59.716 INFO:tasks.ceph:Setting up mon.a... 2024-01-27T13:30:59.717 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-27T13:30:59.773 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.keyring 2024-01-27T13:30:59.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-27T13:30:59.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-27T13:30:59.849 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.46'), ('mon.b', '172.21.15.78'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]')] 2024-01-27T13:30:59.849 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.46,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-27T13:30:59.850 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:30:59.850 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-27T13:30:59.904 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.46 --add b 172.21.15.78 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:30:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:30:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: generated fsid cd306d9e-23fd-46fc-bd31-5e5759cfb03c 2024-01-27T13:30:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-01-27T13:30:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 0 2024-01-27T13:30:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:fsid cd306d9e-23fd-46fc-bd31-5e5759cfb03c 2024-01-27T13:30:59.989 INFO:teuthology.orchestra.run.smithi046.stdout:last_changed 2024-01-27T13:30:59.997652+0000 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-01-27T13:30:59.997652+0000 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:min_mon_release 17 (quincy) 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:election_strategy: 1 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.b 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-01-27T13:30:59.990 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-27T13:30:59.991 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-27T13:31:00.005 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cd306d9e-23fd-46fc-bd31-5e5759cfb03c... 2024-01-27T13:31:00.006 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-27T13:31:00.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-27T13:31:00.094 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: chdir = "" 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: auth supported = cephx 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: filestore xattr use omap = true 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.095 INFO:teuthology.orchestra.run.smithi046.stdout: mon clock drift allowed = 1.000 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: osd crush chooseleaf type = 0 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: auth debug = true 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on old message = true 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: ms die on bug = true 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: mon pg warn max object skew = 0 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: # disable pg_autoscaler by default for new pools 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.096 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default size = 2 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow primary affinity = true 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd allow pg remap = true 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on legacy crush tunables = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on crush straw calc version zero = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on no sortbitwise = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on osd down out interval zero = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon warn on too few osds = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: mon_allow_pool_size_one = true 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.097 INFO:teuthology.orchestra.run.smithi046.stdout: osd default data pool replay window = 5 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: mon allow pool delete = true 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: mon cluster log file level = debug 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: debug asserts on shutdown = true 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: mon health detail to clog = false 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: mon host = "172.21.15.46,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: mds beacon grace = 60 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: mds heartbeat grace = 60 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: osd heartbeat grace = 60 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = cd306d9e-23fd-46fc-bd31-5e5759cfb03c 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout:[osd] 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: osd journal size = 100 2024-01-27T13:31:00.098 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub load threshold = 5.0 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd scrub max interval = 600 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd mclock profile = high_recovery_ops 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd recover clone overlap = true 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd recovery max chunk = 1048576 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug shutdown = true 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug op order = true 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug verify stray on activate = true 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug trim objects = true 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd open classes on start = true 2024-01-27T13:31:00.099 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug pg log writeout = true 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: osd deep scrub update digest min age = 30 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: osd map max advance = 10 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: journal zero on create = true 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: filestore ondisk finisher threads = 3 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: filestore apply finisher threads = 3 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: bdev debug aio = true 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: osd debug misdirected ops = true 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore block size = 96636764160 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore compression mode = aggressive 2024-01-27T13:31:00.100 INFO:teuthology.orchestra.run.smithi046.stdout: bluestore fsck on mount = True 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluefs = 20 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: debug bluestore = 20 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: debug osd = 20 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: debug rocksdb = 10 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd backfillfull_ratio = 0.85 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd full ratio = 0.9 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd nearfull ratio = 0.8 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: osd failsafe full ratio = 0.95 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: osd fast shutdown = False 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: osd objectstore = bluestore 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr] 2024-01-27T13:31:00.101 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug mgr = 20 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: mgr/telemetry/nag = false 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout:[mon] 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug mon = 20 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug paxos = 20 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: debug auth = 20 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: mon data avail warn = 5 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: mon mgr mkfs grace = 240 2024-01-27T13:31:00.102 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min pgs per osd = 4 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd reporter subtree level = osd 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd prime pg temp = true 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon reweight min bytes per osd = 10 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: auth mon ticket ttl = 660 # 11m 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: auth service ticket ttl = 240 # 4m 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: # don't complain about insecure global_id in the test suite 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: # 1m isn't quite enough 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon_down_mkfs_grace = 2m 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.103 INFO:teuthology.orchestra.run.smithi046.stdout: mon_warn_on_filestore_osds = false 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: mon op complaint time = 120 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: mon osd crush smoke test = False 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout:[client] 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: rgw cache enabled = true 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable ops log = true 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: rgw enable usage log = true 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: client mount timeout = 600 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: debug client = 20 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-01-27T13:31:00.104 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.a] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.b] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mon.c] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout:[mds] 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds = 20 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: debug mds balancer = 20 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: debug ms = 1 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug frag = True 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: mds debug scatterstat = True 2024-01-27T13:31:00.105 INFO:teuthology.orchestra.run.smithi046.stdout: mds op complaint time = 180 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi046.stdout: mds valgrind exit = True 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi046.stdout: mds verify scatter = True 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi046.stdout: osd op complaint time = 180 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi046.stdout: rados mon op timeout = 900 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi046.stdout: rados osd op timeout = 900 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-27T13:31:00.106 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-01-27T13:31:00.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-27T13:31:00.108 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.46,172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790]" 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: mds beacon grace = 60 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: mds heartbeat grace = 60 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: osd heartbeat grace = 60 2024-01-27T13:31:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = cd306d9e-23fd-46fc-bd31-5e5759cfb03c 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-01-27T13:31:00.110 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-01-27T13:31:00.111 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: osd fast shutdown = False 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-01-27T13:31:00.112 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-01-27T13:31:00.113 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd crush smoke test = False 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2024-01-27T13:31:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2024-01-27T13:31:00.116 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: mds valgrind exit = True 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2024-01-27T13:31:00.117 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2024-01-27T13:31:00.118 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-27T13:31:00.119 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-27T13:31:00.213 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-27T13:31:00.213 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:00.213 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-27T13:31:00.228 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:00.228 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-27T13:31:00.282 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:31:00.283 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:00.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-27T13:31:00.283 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-27T13:31:00.361 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:00.361 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:00.415 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T13:31:00.415 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:00.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-27T13:31:00.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-27T13:31:00.460 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:00.460 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:00.517 INFO:tasks.ceph:Setting up mon nodes... 2024-01-27T13:31:00.517 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-27T13:31:00.517 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-27T13:31:00.570 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-27T13:31:00.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-27T13:31:00.649 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-27T13:31:00.651 INFO:tasks.ceph:Setting up mds nodes... 2024-01-27T13:31:00.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-27T13:31:00.706 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-27T13:31:00.708 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-27T13:31:00.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-27T13:31:00.829 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-27T13:31:00.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-27T13:31:00.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-01-27T13:31:00.953 INFO:teuthology.orchestra.run.smithi046.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-01-27T13:31:00.956 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-01-27T13:31:00.982 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-27T13:31:01.046 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-27T13:31:01.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-27T13:31:01.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-27T13:31:01.173 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-27T13:31:01.176 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-27T13:31:01.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-01-27T13:31:01.296 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-01-27T13:31:01.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-01-27T13:31:01.325 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-27T13:31:01.325 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-27T13:31:01.368 INFO:teuthology.orchestra.run.smithi046.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-27T13:31:01.383 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-27T13:31:01.383 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-27T13:31:01.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-27T13:31:01.450 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:01.450 INFO:tasks.ceph:role: osd.0 2024-01-27T13:31:01.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:31:01.450 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-27T13:31:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:01.516 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:01.548 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T13:31:01.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T13:31:01.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-27T13:31:01.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-27T13:31:01.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-27T13:31:01.761 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:01.761 INFO:tasks.ceph:role: osd.1 2024-01-27T13:31:01.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:31:01.762 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-27T13:31:01.827 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:01.827 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:01.827 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:01.828 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:01.861 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T13:31:01.862 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T13:31:01.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-27T13:31:01.932 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-27T13:31:02.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-27T13:31:02.070 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:02.070 INFO:tasks.ceph:role: osd.2 2024-01-27T13:31:02.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:31:02.070 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:02.137 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:02.138 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:02.138 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:02.171 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T13:31:02.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T13:31:02.173 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-27T13:31:02.244 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-27T13:31:02.315 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-27T13:31:02.382 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:02.382 INFO:tasks.ceph:role: osd.3 2024-01-27T13:31:02.382 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:31:02.382 DEBUG:teuthology.orchestra.run.smithi046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:02.448 INFO:teuthology.orchestra.run.smithi046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:02.480 INFO:teuthology.orchestra.run.smithi046.stdout:Discarding blocks...Done. 2024-01-27T13:31:02.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi046.front.sepia.ceph.com -o noatime 2024-01-27T13:31:02.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-27T13:31:02.557 DEBUG:teuthology.orchestra.run.smithi046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-27T13:31:02.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:02.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:02.742+0000 7f519bef7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-27T13:31:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:02.743+0000 7f519bef7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-27T13:31:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:02.743+0000 7f519bef7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-27T13:31:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:02.743+0000 7f519bef7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-27T13:31:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:02.743+0000 7f519bef7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-27T13:31:02.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:02.743+0000 7f519bef7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-27T13:31:05.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-27T13:31:05.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:05.713+0000 7f1323785640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-27T13:31:05.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:05.713+0000 7f1323785640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-27T13:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:05.713+0000 7f1323785640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-27T13:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:05.713+0000 7f1323785640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-27T13:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:05.713+0000 7f1323785640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-27T13:31:05.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:05.713+0000 7f1323785640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-27T13:31:08.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-27T13:31:08.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:08.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:08.686+0000 7f7bdde1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-27T13:31:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:08.687+0000 7f7bdde1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-27T13:31:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:08.687+0000 7f7bdde1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-27T13:31:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:08.687+0000 7f7bdde1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-27T13:31:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:08.687+0000 7f7bdde1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-27T13:31:08.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:08.687+0000 7f7bdde1e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-27T13:31:11.527 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-27T13:31:11.559 DEBUG:teuthology.orchestra.run.smithi046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:11.659+0000 7f7dc6414640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-27T13:31:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:11.659+0000 7f7dc6414640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-27T13:31:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:11.659+0000 7f7dc6414640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-27T13:31:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:11.659+0000 7f7dc6414640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-27T13:31:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:11.659+0000 7f7dc6414640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-27T13:31:11.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:11.659+0000 7f7dc6414640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-27T13:31:14.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-27T13:31:14.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-27T13:31:14.561 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:14.561 INFO:tasks.ceph:role: osd.4 2024-01-27T13:31:14.562 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T13:31:14.562 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-27T13:31:14.638 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:14.638 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:14.638 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:14.639 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:15.131 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-01-27T13:31:15.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-01-27T13:31:15.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-27T13:31:15.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-27T13:31:15.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-27T13:31:15.374 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:15.374 INFO:tasks.ceph:role: osd.5 2024-01-27T13:31:15.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T13:31:15.374 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:15.449 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:15.450 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:15.450 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:15.450 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:15.915 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-01-27T13:31:15.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-01-27T13:31:15.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-27T13:31:16.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-27T13:31:16.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-27T13:31:16.113 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:16.113 INFO:tasks.ceph:role: osd.6 2024-01-27T13:31:16.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T13:31:16.113 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-27T13:31:16.187 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:16.187 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:16.187 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:16.188 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:16.674 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-01-27T13:31:16.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-01-27T13:31:16.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-27T13:31:16.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-27T13:31:16.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-27T13:31:16.904 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-27T13:31:16.904 INFO:tasks.ceph:role: osd.7 2024-01-27T13:31:16.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T13:31:16.904 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-27T13:31:16.979 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-27T13:31:16.980 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-27T13:31:17.499 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-01-27T13:31:17.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-01-27T13:31:17.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-27T13:31:17.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-27T13:31:17.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:17.830+0000 7fc3f8a24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-27T13:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:17.830+0000 7fc3f8a24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-27T13:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:17.830+0000 7fc3f8a24640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-27T13:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:17.830+0000 7fc3f8a24640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-27T13:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:17.830+0000 7fc3f8a24640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-27T13:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:17.831+0000 7fc3f8a24640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-27T13:31:20.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-27T13:31:20.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:20.790+0000 7ff5ea448640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-27T13:31:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:20.790+0000 7ff5ea448640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-27T13:31:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:20.790+0000 7ff5ea448640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-27T13:31:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:20.790+0000 7ff5ea448640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-27T13:31:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:20.790+0000 7ff5ea448640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-27T13:31:20.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:20.791+0000 7ff5ea448640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-27T13:31:23.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-27T13:31:23.666 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:23.762+0000 7f2db8419640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-27T13:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:23.763+0000 7f2db8419640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-27T13:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:23.763+0000 7f2db8419640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-27T13:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:23.763+0000 7f2db8419640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-27T13:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:23.763+0000 7f2db8419640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-27T13:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:23.763+0000 7f2db8419640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-27T13:31:26.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-27T13:31:26.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:26.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:26.729+0000 7f7a6ed73640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-27T13:31:26.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:26.729+0000 7f7a6ed73640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-27T13:31:26.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:26.729+0000 7f7a6ed73640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-27T13:31:26.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:26.729+0000 7f7a6ed73640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-27T13:31:26.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:26.729+0000 7f7a6ed73640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-27T13:31:26.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:26.729+0000 7f7a6ed73640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-27T13:31:28.124 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:31:28.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:31:29.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-27T13:31:29.602 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-27T13:31:29.602 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.602 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-27T13:31:29.633 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-27T13:31:29.703 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-27T13:31:29.773 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.773 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-01-27T13:31:29.843 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.843 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-27T13:31:29.911 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-27T13:31:29.979 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:29.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-27T13:31:30.046 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:30.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-27T13:31:30.113 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-27T13:31:30.145 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-27T13:31:30.216 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.217 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-27T13:31:30.287 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.287 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-01-27T13:31:30.356 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.356 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-27T13:31:30.424 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-27T13:31:30.492 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.492 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-27T13:31:30.559 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:30.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-27T13:31:30.628 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:30.628 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-27T13:31:30.646 INFO:tasks.ceph:Adding keys to all mons... 2024-01-27T13:31:30.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-27T13:31:30.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-27T13:31:30.713 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-01-27T13:31:30.713 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCUBbVlPj+IIhAA9R/2wopiLp2UCK20UCqkig== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCUBbVliBuYKhAApOHsVH9rEV+aO6r1Wc8qng== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCUBbVlhLT2MRAAnk2jDXsc1nA0T4cU297/9g== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.e] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCUBbVlOzRcORAAjKQpK0lu46belzIsLg/tEg== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCWBbVlFDVULBAA2NsEmkgO4uzsBqPvv13Kpw== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCZBbVlRXKPKhAAaHtfqFHvhLN+F3y3+3KHPQ== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCcBbVlLXz9KBAAYlM72Mc8mAg67SS0+Gko0Q== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCfBbVlEXtYJxAAbwYUYf5dj0WYPcCDZzRRvg== 2024-01-27T13:31:30.714 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCUBbVlYowzJxAAIHLFonsdo65TppnjT7WvwQ== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCVBbVlVtc+AxAA42EPsb8QpAZV22qqFzfMZw== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCVBbVlrqfYChAA3WftKj7NwPDLIPRQkuNibA== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.f] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCVBbVlOjIxEhAAMW1oW7GReWG1tVl8p/8Jnw== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQClBbVlwZ6IMRAALTYTPU3cYoi1nKb0jhG7wg== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCoBbVlARQtLxAA3eNL4rqTZtHsgqaYPAe0Kw== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCrBbVlNn2FLRAAJQ7IDYVNlKNnSPjUOcKUxQ== 2024-01-27T13:31:30.715 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-01-27T13:31:30.716 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCuBbVl8faBKxAA6vJjmki4MO+xF7bh7BH4ug== 2024-01-27T13:31:30.716 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-01-27T13:31:30.716 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCVBbVl4hV1FhAA6itRWc4ENhWsp6jrmuLeww== 2024-01-27T13:31:30.717 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.y] 2024-01-27T13:31:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCUBbVlPj+IIhAA9R/2wopiLp2UCK20UCqkig== 2024-01-27T13:31:30.717 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a] 2024-01-27T13:31:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCUBbVliBuYKhAApOHsVH9rEV+aO6r1Wc8qng== 2024-01-27T13:31:30.717 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCUBbVlhLT2MRAAnk2jDXsc1nA0T4cU297/9g== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCUBbVlOzRcORAAjKQpK0lu46belzIsLg/tEg== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.0] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCWBbVlFDVULBAA2NsEmkgO4uzsBqPvv13Kpw== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.1] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCZBbVlRXKPKhAAaHtfqFHvhLN+F3y3+3KHPQ== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.2] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCcBbVlLXz9KBAAYlM72Mc8mAg67SS0+Gko0Q== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.3] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCfBbVlEXtYJxAAbwYUYf5dj0WYPcCDZzRRvg== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[mgr.x] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCUBbVlYowzJxAAIHLFonsdo65TppnjT7WvwQ== 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b] 2024-01-27T13:31:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCVBbVlVtc+AxAA42EPsb8QpAZV22qqFzfMZw== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCVBbVlrqfYChAA3WftKj7NwPDLIPRQkuNibA== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCVBbVlOjIxEhAAMW1oW7GReWG1tVl8p/8Jnw== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.4] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQClBbVlwZ6IMRAALTYTPU3cYoi1nKb0jhG7wg== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.5] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCoBbVlARQtLxAA3eNL4rqTZtHsgqaYPAe0Kw== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.6] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCrBbVlNn2FLRAAJQ7IDYVNlKNnSPjUOcKUxQ== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[osd.7] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCuBbVl8faBKxAA6vJjmki4MO+xF7bh7BH4ug== 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-01-27T13:31:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQCVBbVl4hV1FhAA6itRWc4ENhWsp6jrmuLeww== 2024-01-27T13:31:30.720 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T13:31:30.760 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T13:31:30.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:30.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:30.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:30.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:30.930 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:30.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:30.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:30.989 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.150 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.204 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T13:31:31.206 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-27T13:31:31.258 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:31.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:31.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:31.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:31.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:31.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-27T13:31:31.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.482 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-27T13:31:31.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-27T13:31:31.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-27T13:31:31.701 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-27T13:31:31.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-27T13:31:31.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-27T13:31:31.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-27T13:31:31.849 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-27T13:31:31.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-27T13:31:31.972 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-27T13:31:31.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-27T13:31:32.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-27T13:31:32.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-27T13:31:32.189 DEBUG:teuthology.orchestra.run.smithi046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:32.191 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-27T13:31:32.244 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-27T13:31:32.244 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T13:31:32.245 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-27T13:31:32.245 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-27T13:31:32.247 INFO:tasks.ceph.mon.a:Started 2024-01-27T13:31:32.247 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T13:31:32.248 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-27T13:31:32.248 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-27T13:31:32.287 INFO:tasks.ceph.mon.b:Started 2024-01-27T13:31:32.287 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T13:31:32.287 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-27T13:31:32.287 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-27T13:31:32.289 INFO:tasks.ceph.mon.c:Started 2024-01-27T13:31:32.289 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-27T13:31:32.289 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-27T13:31:32.289 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-27T13:31:32.291 INFO:tasks.ceph.mgr.y:Started 2024-01-27T13:31:32.292 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-27T13:31:32.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-27T13:31:32.294 INFO:tasks.ceph.mgr.x:Started 2024-01-27T13:31:32.294 INFO:tasks.ceph:Setting crush tunables to default 2024-01-27T13:31:32.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph osd crush tunables default 2024-01-27T13:31:32.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.402+0000 7fa6a2ebb640 1 Processor -- start 2024-01-27T13:31:32.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.402+0000 7fa6a2ebb640 1 -- start start 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a2ebb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 0x7fa69c070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a2ebb640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 0x7fa69c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a2ebb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c15bb20 con 0x7fa69c151770 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a2ebb640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c15b840 con 0x7fa69c0711c0 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a2ebb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c157740 con 0x7fa69c0ca480 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a1458640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 msgr2=0x7fa69c15ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a1458640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 0x7fa69c15ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa69bfff640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 msgr2=0x7fa69c070c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa69c151770 legacy=0x7fa69c0c1d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:32.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.403+0000 7fa69bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 0x7fa69c070c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.604+0000 7fa6a1458640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 msgr2=0x7fa69c15ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T13:31:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.604+0000 7fa6a1458640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 0x7fa69c15ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T13:31:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.604+0000 7fa69bfff640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 msgr2=0x7fa69c070c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.604+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa69c151770 legacy=0x7fa69c0c1d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:32.604+0000 7fa69bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 0x7fa69c070c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T13:31:32.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.005+0000 7fa6a1458640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 msgr2=0x7fa69c15ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T13:31:32.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.005+0000 7fa6a1458640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 0x7fa69c15ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T13:31:32.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.005+0000 7fa69bfff640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 msgr2=0x7fa69c070c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:32.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.005+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa69c151770 legacy=0x7fa69c0c1d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:32.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.005+0000 7fa69bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 0x7fa69c070c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T13:31:33.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.806+0000 7fa6a1458640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 msgr2=0x7fa69c15ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.46:3300/0 2024-01-27T13:31:33.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.806+0000 7fa6a1458640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 0x7fa69c15ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T13:31:33.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.806+0000 7fa69bfff640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 msgr2=0x7fa69c070c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.806+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa69c151770 legacy=0x7fa69c0c1d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:33.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:33.806+0000 7fa69bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 0x7fa69c070c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 msgr2=0x7fa69c070c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa69c0ca480 0x7fa69c070c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 -- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 msgr2=0x7fa69c15ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa69c0711c0 0x7fa69c15ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa69c151770 legacy=0x7fa69c0c1d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 0x7fa688009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c157a20 con 0x7fa6880036b0 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69a7fc640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c15b840 con 0x7fa688007360 2024-01-27T13:31:35.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa6a0c57640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa6880036b0 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:35.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69bfff640 1 -- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 msgr2=0x7fa688009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2024-01-27T13:31:35.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.403+0000 7fa69bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 0x7fa688009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.604+0000 7fa6a0c57640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa6880036b0 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.604+0000 7fa69bfff640 1 -- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 msgr2=0x7fa688009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2024-01-27T13:31:35.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:35.604+0000 7fa69bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 0x7fa688009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T13:31:35.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:36.005+0000 7fa6a0c57640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa6880036b0 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:35.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:36.005+0000 7fa69bfff640 1 -- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 msgr2=0x7fa688009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2024-01-27T13:31:35.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:36.005+0000 7fa69bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 0x7fa688009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T13:31:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:36.806+0000 7fa6a0c57640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa6880036b0 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:36.806+0000 7fa69bfff640 1 -- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 msgr2=0x7fa688009820 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3300/0 2024-01-27T13:31:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:36.806+0000 7fa69bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 0x7fa688009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T13:31:38.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 -- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 msgr2=0x7fa688009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:38.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa688007360 0x7fa688009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:38.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa6880036b0 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:38.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa6a1458640 1 -- reap_dead start 2024-01-27T13:31:38.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa68800e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:38.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c15bb20 con 0x7fa68800aa80 2024-01-27T13:31:38.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c157a20 con 0x7fa688009ef0 2024-01-27T13:31:38.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69bfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa68800aa80 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:38.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa69a7fc640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c15b840 con 0x7fa6880098e0 2024-01-27T13:31:38.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa688009ef0 legacy=0x7fa68800a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:38.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa6a1458640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 msgr2=0x7fa68800e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:38.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.403+0000 7fa6a1458640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa68800e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:38.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.604+0000 7fa69bfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa68800aa80 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:38.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.604+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa688009ef0 legacy=0x7fa68800a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:38.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.604+0000 7fa6a1458640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 msgr2=0x7fa68800e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:38.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:38.604+0000 7fa6a1458640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa68800e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T13:31:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.005+0000 7fa69bfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa68800aa80 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.005+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa688009ef0 legacy=0x7fa68800a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:38.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.005+0000 7fa6a1458640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 msgr2=0x7fa68800e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:38.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.005+0000 7fa6a1458640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa68800e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T13:31:39.284 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:00:06.873 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:31:39.287 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:00:06.877 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:31:39.595 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:07.245 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:31:39.599 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:00:07.189 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:31:39.603 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:00:07.192 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:31:39.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.806+0000 7fa69bfff640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa68800aa80 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.46:6789/0 2024-01-27T13:31:39.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.806+0000 7fa6a0c57640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa688009ef0 legacy=0x7fa68800a2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.78:6789/0 2024-01-27T13:31:39.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.806+0000 7fa6a1458640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 msgr2=0x7fa68800e070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.78:3301/0 2024-01-27T13:31:39.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:39.806+0000 7fa6a1458640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa68800e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T13:31:39.922 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:00:07.572 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 msgr2=0x7fa68800e070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa68800e070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 -- >> v1:172.21.15.78:6789/0 conn(0x7fa688009ef0 legacy=0x7fa68800a2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 -- >> v1:172.21.15.46:6789/0 conn(0x7fa68800aa80 legacy=0x7fa688005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c15b840 con 0x7fa6880102c0 2024-01-27T13:31:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.403+0000 7fa69a7fc640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c157740 con 0x7fa68800f810 2024-01-27T13:31:41.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.485+0000 7fa69bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:41.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.570+0000 7fa69bfff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40508/0 (socket says 172.21.15.46:40508) 2024-01-27T13:31:41.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.570+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 learned_addr learned my addr 172.21.15.46:0/4279923211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:41.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.589+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T13:31:41.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.589+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:41.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.589+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:41.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.589+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:41.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.759+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:41.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.845+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T13:31:41.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.845+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:41.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.845+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:41.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:41.845+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:42.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.046+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.059+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T13:31:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.059+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.059+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:42.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.059+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T13:31:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.101+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:42.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.140+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T13:31:42.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.140+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:42.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.140+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:42.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.140+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-27T13:31:42.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.461+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.461+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T13:31:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.461+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.461+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:42.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.461+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T13:31:42.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.632+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.731+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T13:31:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.731+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.731+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:42.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:42.731+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-27T13:31:43.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.263+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:43.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.264+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T13:31:43.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.264+0000 7fa6a0c57640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:43.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.264+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:43.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.264+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T13:31:43.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.592+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.595+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-27T13:31:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.595+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.595+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:43.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:43.595+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-27T13:31:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa68800f810 0x7fa68800fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-27T13:31:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.46:3300/0 conn(0x7fa6880102c0 0x7fa68800e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa6a1458640 1 -- 172.21.15.46:0/4279923211 reap_dead start 2024-01-27T13:31:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 0x7fa68800fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 0x7fa68800e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 -- 172.21.15.46:0/4279923211 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa688010860 con 0x7fa688009ef0 2024-01-27T13:31:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 -- 172.21.15.46:0/4279923211 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c15b840 con 0x7fa6880098e0 2024-01-27T13:31:44.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.404+0000 7fa69a7fc640 1 -- 172.21.15.46:0/4279923211 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c157740 con 0x7fa68800a9e0 2024-01-27T13:31:44.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.435+0000 7fa6a1458640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 0x7fa68800e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:44.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.561+0000 7fa6a1458640 1 -- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-27T13:31:44.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.561+0000 7fa6a1458640 1 -- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:44.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.561+0000 7fa6a1458640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 0x7fa68800e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:44.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.561+0000 7fa6a1458640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 0x7fa68800e6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:44.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.569+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 0x7fa68800fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:44.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.571+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-27T13:31:44.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.571+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 msgr2=0x7fa68800fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-27T13:31:44.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.571+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 0x7fa68800fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-27T13:31:44.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.571+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 0x7fa68800fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-27T13:31:44.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.770+0000 7fa69b7fe640 1 -- 172.21.15.46:0/4279923211 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416077973 0 0) 0x7fa688010860 con 0x7fa688009ef0 2024-01-27T13:31:44.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.770+0000 7fa69b7fe640 1 -- 172.21.15.46:0/4279923211 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa684003520 con 0x7fa688009ef0 2024-01-27T13:31:44.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.776+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> v2:172.21.15.78:3300/0 conn(0x7fa6880098e0 0x7fa68800fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.823+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 msgr2=0x7fa68800e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.823+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 0x7fa68800e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.823+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 >> v1:172.21.15.78:6789/0 conn(0x7fa688009ef0 legacy=0x7fa68800a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:44.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.823+0000 7fa69bfff640 1 -- 172.21.15.46:0/4279923211 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c15bb20 con 0x7fa6880098e0 2024-01-27T13:31:44.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.836+0000 7fa69bfff640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6880098e0 0x7fa68800fbf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa690009540 tx=0x7fa690005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d6c59a8f33821c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:44.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.885+0000 7fa69b7fe640 1 -- 172.21.15.46:0/4279923211 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69002dd60 con 0x7fa6880098e0 2024-01-27T13:31:44.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.885+0000 7fa69b7fe640 1 -- 172.21.15.46:0/4279923211 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa690031070 con 0x7fa6880098e0 2024-01-27T13:31:44.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.885+0000 7fa69b7fe640 1 -- 172.21.15.46:0/4279923211 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690037640 con 0x7fa6880098e0 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6880098e0 msgr2=0x7fa68800fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6880098e0 0x7fa68800fbf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa690009540 tx=0x7fa690005040 comp rx=0 tx=0).stop 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/4279923211 shutdown_connections 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa68800a9e0 0x7fa68800e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/4279923211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6880098e0 0x7fa68800fbf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/4279923211 >> 172.21.15.46:0/4279923211 conn(0x7fa69c06f030 msgr2=0x7fa69c06f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/4279923211 shutdown_connections 2024-01-27T13:31:44.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.886+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/4279923211 wait complete. 2024-01-27T13:31:44.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.887+0000 7fa6a2ebb640 1 Processor -- start 2024-01-27T13:31:44.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.887+0000 7fa6a2ebb640 1 -- start start 2024-01-27T13:31:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.888+0000 7fa6a2ebb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa69c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.888+0000 7fa6a2ebb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa688009ef0 0x7fa69c1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.888+0000 7fa6a2ebb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68800a9e0 0x7fa69c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.888+0000 7fa6a2ebb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c1ef690 con 0x7fa688009ef0 2024-01-27T13:31:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.888+0000 7fa6a2ebb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c1efb80 con 0x7fa68800a9e0 2024-01-27T13:31:44.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.888+0000 7fa6a2ebb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c0c8f00 con 0x7fa6880098e0 2024-01-27T13:31:44.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.918+0000 7fa6a0c57640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa69c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:44.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.919+0000 7fa6a0c57640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa69c0c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:45046/0 (socket says 172.21.15.46:45046) 2024-01-27T13:31:44.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.919+0000 7fa6a0c57640 1 -- 172.21.15.46:0/3807088227 learned_addr learned my addr 172.21.15.46:0/3807088227 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:44.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.932+0000 7fa69bfff640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa688009ef0 0x7fa69c1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:44.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.935+0000 7fa6a1458640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68800a9e0 0x7fa69c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.936+0000 7fa6a0c57640 1 -- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68800a9e0 msgr2=0x7fa69c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.936+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68800a9e0 0x7fa69c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.936+0000 7fa6a0c57640 1 -- 172.21.15.46:0/3807088227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa688009ef0 msgr2=0x7fa69c1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.936+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa688009ef0 0x7fa69c1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:44.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.936+0000 7fa6a0c57640 1 -- 172.21.15.46:0/3807088227 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690009bb0 con 0x7fa6880098e0 2024-01-27T13:31:44.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.940+0000 7fa6a0c57640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa69c0c48d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa68c007100 tx=0x7fa68c009fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:44.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.945+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c017400 con 0x7fa6880098e0 2024-01-27T13:31:44.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.945+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c017560 con 0x7fa6880098e0 2024-01-27T13:31:44.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.945+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0178d0 con 0x7fa6880098e0 2024-01-27T13:31:44.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.945+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c1ef8a0 con 0x7fa6880098e0 2024-01-27T13:31:44.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.945+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c0c9480 con 0x7fa6880098e0 2024-01-27T13:31:44.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.946+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c074410 con 0x7fa6880098e0 2024-01-27T13:31:44.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.966+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa68c017a30 con 0x7fa6880098e0 2024-01-27T13:31:44.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:44.966+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa68c00b770 con 0x7fa6880098e0 2024-01-27T13:31:45.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.143+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fa68c026060 con 0x7fa6880098e0 2024-01-27T13:31:45.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.210+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa69c0c9ed0 con 0x7fa6880098e0 2024-01-27T13:31:45.425 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:45.433+0000 7f2368e17040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-27T13:31:45.437 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:45.445+0000 7fe472e45040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-27T13:31:45.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.448+0000 7fa6997fa640 1 -- 172.21.15.46:0/3807088227 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa68c01c070 con 0x7fa6880098e0 2024-01-27T13:31:45.440 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 msgr2=0x7fa69c0c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa69c0c48d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa68c007100 tx=0x7fa68c009fb0 comp rx=0 tx=0).stop 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 shutdown_connections 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa68800a9e0 0x7fa69c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa688009ef0 0x7fa69c1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 --2- 172.21.15.46:0/3807088227 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa6880098e0 0x7fa69c0c48d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 >> 172.21.15.46:0/3807088227 conn(0x7fa69c06f030 msgr2=0x7fa69c06f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 shutdown_connections 2024-01-27T13:31:45.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:45.449+0000 7fa6a2ebb640 1 -- 172.21.15.46:0/3807088227 wait complete. 2024-01-27T13:31:45.452 INFO:tasks.ceph:check_enable_crimson: False 2024-01-27T13:31:45.452 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-27T13:31:45.452 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:45.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-27T13:31:45.479 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:45.479 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-27T13:31:45.486 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:45.494+0000 7f2368e17040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-27T13:31:45.495 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:45.502+0000 7fe472e45040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-27T13:31:45.520 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:45.520 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-27T13:31:45.587 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:31:45.587 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-27T13:31:45.654 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:45.654 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-27T13:31:45.681 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:45.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-27T13:31:45.748 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:45.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-27T13:31:45.816 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-01-27T13:31:45.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-27T13:31:45.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new f4e9cd0b-5371-426a-850b-ea56d4b74e12 0 2024-01-27T13:31:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.032+0000 7f6bca046640 1 Processor -- start 2024-01-27T13:31:46.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.032+0000 7f6bca046640 1 -- start start 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.033+0000 7f6bca046640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6bc41516c0 0x7f6bc40c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.033+0000 7f6bca046640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bc40cc1a0 0x7f6bc40c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.033+0000 7f6bca046640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 0x7f6bc4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.033+0000 7f6bca046640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc406a710 con 0x7f6bc40cc1a0 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.033+0000 7f6bca046640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc4072d00 con 0x7f6bc41516c0 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.033+0000 7f6bca046640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc415b5c0 con 0x7f6bc406b940 2024-01-27T13:31:46.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.034+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 0x7f6bc4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.034+0000 7f6bc2ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6bc40cc1a0 0x7f6bc40c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.034+0000 7f6bc37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6bc41516c0 0x7f6bc40c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.034+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 0x7f6bc4157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46954/0 (socket says 172.21.15.78:46954) 2024-01-27T13:31:46.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.034+0000 7f6bc3fff640 1 -- 172.21.15.78:0/515823879 learned_addr learned my addr 172.21.15.78:0/515823879 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:46.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.036+0000 7f6bc3fff640 1 -- 172.21.15.78:0/515823879 >> v2:172.21.15.78:3300/0 conn(0x7f6bc41516c0 msgr2=0x7f6bc40c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.036+0000 7f6bc3fff640 1 --2- 172.21.15.78:0/515823879 >> v2:172.21.15.78:3300/0 conn(0x7f6bc41516c0 0x7f6bc40c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.036+0000 7f6bc3fff640 1 -- 172.21.15.78:0/515823879 >> v2:172.21.15.46:3300/0 conn(0x7f6bc40cc1a0 msgr2=0x7f6bc40c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.036+0000 7f6bc3fff640 1 --2- 172.21.15.78:0/515823879 >> v2:172.21.15.46:3300/0 conn(0x7f6bc40cc1a0 0x7f6bc40c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.036+0000 7f6bc3fff640 1 -- 172.21.15.78:0/515823879 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc415b8a0 con 0x7f6bc406b940 2024-01-27T13:31:46.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.038+0000 7f6bc3fff640 1 --2- 172.21.15.78:0/515823879 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 0x7f6bc4157b50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40cc150 tx=0x7f6bbc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fb76a458667f304 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bc27fc640 1 -- 172.21.15.78:0/515823879 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc02ca70 con 0x7f6bc406b940 2024-01-27T13:31:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bc27fc640 1 -- 172.21.15.78:0/515823879 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc02cbd0 con 0x7f6bc406b940 2024-01-27T13:31:46.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bc27fc640 1 -- 172.21.15.78:0/515823879 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0343f0 con 0x7f6bc406b940 2024-01-27T13:31:46.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bca046640 1 -- 172.21.15.78:0/515823879 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 msgr2=0x7f6bc4157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bca046640 1 --2- 172.21.15.78:0/515823879 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 0x7f6bc4157b50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40cc150 tx=0x7f6bbc02bed0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bca046640 1 -- 172.21.15.78:0/515823879 shutdown_connections 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bca046640 1 --2- 172.21.15.78:0/515823879 >> v2:172.21.15.46:3300/0 conn(0x7f6bc40cc1a0 0x7f6bc40c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.042+0000 7f6bca046640 1 --2- 172.21.15.78:0/515823879 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc406b940 0x7f6bc4157b50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.043+0000 7f6bca046640 1 --2- 172.21.15.78:0/515823879 >> v2:172.21.15.78:3300/0 conn(0x7f6bc41516c0 0x7f6bc40c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.043+0000 7f6bca046640 1 -- 172.21.15.78:0/515823879 >> 172.21.15.78:0/515823879 conn(0x7f6bc40c8620 msgr2=0x7f6bc40cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.043+0000 7f6bca046640 1 -- 172.21.15.78:0/515823879 shutdown_connections 2024-01-27T13:31:46.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.043+0000 7f6bca046640 1 -- 172.21.15.78:0/515823879 wait complete. 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.044+0000 7f6bca046640 1 Processor -- start 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.044+0000 7f6bca046640 1 -- start start 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bca046640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bc406b940 0x7f6bc41eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bca046640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bc40cc1a0 0x7f6bc41f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bca046640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc41516c0 0x7f6bc40cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bca046640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41efcd0 con 0x7f6bc406b940 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bca046640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41ef250 con 0x7f6bc40cc1a0 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bca046640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41f3160 con 0x7f6bc41516c0 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc41516c0 0x7f6bc40cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bc37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bc406b940 0x7f6bc41eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bc2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bc40cc1a0 0x7f6bc41f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc41516c0 0x7f6bc40cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46958/0 (socket says 172.21.15.78:46958) 2024-01-27T13:31:46.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.045+0000 7f6bc3fff640 1 -- 172.21.15.78:0/3290120007 learned_addr learned my addr 172.21.15.78:0/3290120007 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:46.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.049+0000 7f6bc37fe640 1 -- 172.21.15.78:0/3290120007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc41516c0 msgr2=0x7f6bc40cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.049+0000 7f6bc37fe640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc41516c0 0x7f6bc40cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.049+0000 7f6bc37fe640 1 -- 172.21.15.78:0/3290120007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bc40cc1a0 msgr2=0x7f6bc41f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.049+0000 7f6bc37fe640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bc40cc1a0 0x7f6bc41f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.049+0000 7f6bc37fe640 1 -- 172.21.15.78:0/3290120007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009b30 con 0x7f6bc406b940 2024-01-27T13:31:46.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.052+0000 7f6bc37fe640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bc406b940 0x7f6bc41eed10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e850 tx=0x7f6bb800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:46.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.057+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80095b0 con 0x7f6bc406b940 2024-01-27T13:31:46.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.057+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb800c940 con 0x7f6bc406b940 2024-01-27T13:31:46.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.057+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800ccd0 con 0x7f6bc406b940 2024-01-27T13:31:46.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.057+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc41ef430 con 0x7f6bc406b940 2024-01-27T13:31:46.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.057+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc41ef9f0 con 0x7f6bc406b940 2024-01-27T13:31:46.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.058+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4074410 con 0x7f6bc406b940 2024-01-27T13:31:46.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.061+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6bb8005990 con 0x7f6bc406b940 2024-01-27T13:31:46.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.061+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6bb80137b0 con 0x7f6bc406b940 2024-01-27T13:31:46.062 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.070+0000 7fe472e45040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-27T13:31:46.080 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.088+0000 7f2368e17040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-27T13:31:46.117 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.125+0000 7fe472e45040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-27T13:31:46.131 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.139+0000 7f2368e17040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-27T13:31:46.163 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.171+0000 7fe472e45040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-27T13:31:46.175 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.183+0000 7f2368e17040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-27T13:31:46.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.183+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f6bb8021060 con 0x7f6bc406b940 2024-01-27T13:31:46.219 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.226+0000 7fe472e45040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-27T13:31:46.230 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.238+0000 7f2368e17040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-27T13:31:46.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.255+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4e9cd0b-5371-426a-850b-ea56d4b74e12", "id": 0} v 0) v1 -- 0x7f6bc41481c0 con 0x7f6bc406b940 2024-01-27T13:31:46.263 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.271+0000 7fe472e45040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-27T13:31:46.272 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.280+0000 7f2368e17040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-27T13:31:46.371 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.379+0000 7fe472e45040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-27T13:31:46.373 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.380+0000 7f2368e17040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-27T13:31:46.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.443+0000 7f6babfff640 1 -- 172.21.15.78:0/3290120007 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4e9cd0b-5371-426a-850b-ea56d4b74e12", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6bb8017070 con 0x7f6bc406b940 2024-01-27T13:31:46.436 INFO:teuthology.orchestra.run.smithi078.stdout:0 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bc406b940 msgr2=0x7f6bc41eed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bc406b940 0x7f6bc41eed10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e850 tx=0x7f6bb800ed10 comp rx=0 tx=0).stop 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 shutdown_connections 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6bc41516c0 0x7f6bc40cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bc40cc1a0 0x7f6bc41f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 --2- 172.21.15.78:0/3290120007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bc406b940 0x7f6bc41eed10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.444+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 >> 172.21.15.78:0/3290120007 conn(0x7f6bc40c8620 msgr2=0x7f6bc414ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.445+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 shutdown_connections 2024-01-27T13:31:46.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.445+0000 7f6bca046640 1 -- 172.21.15.78:0/3290120007 wait complete. 2024-01-27T13:31:46.447 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.455+0000 7f2368e17040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-27T13:31:46.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 107b55a1-f6e1-433d-930d-5afe335184fe 1 2024-01-27T13:31:46.453 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.461+0000 7fe472e45040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-27T13:31:46.502 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.509+0000 7fe472e45040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-27T13:31:46.506 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.514+0000 7f2368e17040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-27T13:31:46.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 Processor -- start 2024-01-27T13:31:46.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 -- start start 2024-01-27T13:31:46.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ccc06e0b0 0x7f1ccc0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc0708c0 con 0x7f1ccc06e4d0 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc15dc90 con 0x7f1ccc06e0b0 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.559+0000 7f1cd26ee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1596c0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.560+0000 7f1ccbfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.560+0000 7f1ccb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ccc06e0b0 0x7f1ccc0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.560+0000 7f1ccbfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc06f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46968/0 (socket says 172.21.15.78:46968) 2024-01-27T13:31:46.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.560+0000 7f1ccbfff640 1 -- 172.21.15.78:0/3495223073 learned_addr learned my addr 172.21.15.78:0/3495223073 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.562+0000 7f1ccbfff640 1 -- 172.21.15.78:0/3495223073 >> v2:172.21.15.78:3300/0 conn(0x7f1ccc06e0b0 msgr2=0x7f1ccc0c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.562+0000 7f1ccbfff640 1 --2- 172.21.15.78:0/3495223073 >> v2:172.21.15.78:3300/0 conn(0x7f1ccc06e0b0 0x7f1ccc0c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.562+0000 7f1ccbfff640 1 -- 172.21.15.78:0/3495223073 >> v1:172.21.15.46:6789/0 conn(0x7f1ccc06e4d0 legacy=0x7f1ccc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.562+0000 7f1ccbfff640 1 -- 172.21.15.78:0/3495223073 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc15ce30 con 0x7f1ccc1538a0 2024-01-27T13:31:46.556 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.564+0000 7fe472e45040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-27T13:31:46.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.564+0000 7f1ccbfff640 1 --2- 172.21.15.78:0/3495223073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc06f0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b41e53599594e69 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.568+0000 7f1ccaffd640 1 -- 172.21.15.78:0/3495223073 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc030840 con 0x7f1ccc1538a0 2024-01-27T13:31:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.568+0000 7f1ccaffd640 1 -- 172.21.15.78:0/3495223073 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0309a0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.568+0000 7f1ccaffd640 1 -- 172.21.15.78:0/3495223073 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc030d30 con 0x7f1ccc1538a0 2024-01-27T13:31:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.568+0000 7f1cd26ee640 1 -- 172.21.15.78:0/3495223073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 msgr2=0x7f1ccc06f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.568+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/3495223073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc06f0b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009870 tx=0x7f1cbc02b980 comp rx=0 tx=0).stop 2024-01-27T13:31:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.569+0000 7f1cd26ee640 1 -- 172.21.15.78:0/3495223073 shutdown_connections 2024-01-27T13:31:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.569+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/3495223073 >> v2:172.21.15.78:3300/0 conn(0x7f1ccc06e0b0 0x7f1ccc0c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.569+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/3495223073 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc06f0b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.569+0000 7f1cd26ee640 1 -- 172.21.15.78:0/3495223073 >> 172.21.15.78:0/3495223073 conn(0x7f1ccc0c89a0 msgr2=0x7f1ccc0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:46.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.569+0000 7f1cd26ee640 1 -- 172.21.15.78:0/3495223073 shutdown_connections 2024-01-27T13:31:46.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.569+0000 7f1cd26ee640 1 -- 172.21.15.78:0/3495223073 wait complete. 2024-01-27T13:31:46.562 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.570+0000 7f2368e17040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-27T13:31:46.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.570+0000 7f1cd26ee640 1 Processor -- start 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.570+0000 7f1cd26ee640 1 -- start start 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd26ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ccc06e0b0 0x7f1ccc1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd26ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ccc06e4d0 0x7f1ccc1ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd26ee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd26ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc155090 con 0x7f1ccc06e0b0 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd26ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc14b9d0 con 0x7f1ccc06e4d0 2024-01-27T13:31:46.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd26ee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc154130 con 0x7f1ccc1538a0 2024-01-27T13:31:46.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.571+0000 7f1cd0c8b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.572+0000 7f1ccb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ccc06e4d0 0x7f1ccc1ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.572+0000 7f1cd0c8b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc14b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:46984/0 (socket says 172.21.15.78:46984) 2024-01-27T13:31:46.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.572+0000 7f1cd0c8b640 1 -- 172.21.15.78:0/1945664428 learned_addr learned my addr 172.21.15.78:0/1945664428 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.574+0000 7f1ccbfff640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ccc06e0b0 0x7f1ccc1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.575+0000 7f1cd0c8b640 1 -- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ccc06e4d0 msgr2=0x7f1ccc1ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.575+0000 7f1cd0c8b640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ccc06e4d0 0x7f1ccc1ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.575+0000 7f1cd0c8b640 1 -- 172.21.15.78:0/1945664428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ccc06e0b0 msgr2=0x7f1ccc1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.575+0000 7f1cd0c8b640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ccc06e0b0 0x7f1ccc1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.575+0000 7f1cd0c8b640 1 -- 172.21.15.78:0/1945664428 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0094d0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.577+0000 7f1cd0c8b640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc14b490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c730 tx=0x7f1cc400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.581+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4006d50 con 0x7f1ccc1538a0 2024-01-27T13:31:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.581+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400ce40 con 0x7f1ccc1538a0 2024-01-27T13:31:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.581+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc154410 con 0x7f1ccc1538a0 2024-01-27T13:31:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.581+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4003bb0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.581+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc1549d0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.582+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc1551d0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.584+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1cc400ab80 con 0x7f1ccc1538a0 2024-01-27T13:31:46.607 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:46.614+0000 7fe472e45040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-27T13:31:46.612 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:46.620+0000 7f2368e17040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-27T13:31:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.684+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1cc4012470 con 0x7f1ccc1538a0 2024-01-27T13:31:46.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.684+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f1ccc1551d0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.757+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "107b55a1-f6e1-433d-930d-5afe335184fe", "id": 1} v 0) v1 -- 0x7f1ccc074410 con 0x7f1ccc1538a0 2024-01-27T13:31:46.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.872+0000 7f1cc8ff9640 1 -- 172.21.15.78:0/1945664428 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "107b55a1-f6e1-433d-930d-5afe335184fe", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1cc402a0b0 con 0x7f1ccc1538a0 2024-01-27T13:31:46.865 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-01-27T13:31:46.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 msgr2=0x7f1ccc14b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc14b490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c730 tx=0x7f1cc400cbf0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 shutdown_connections 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ccc1538a0 0x7f1ccc14b490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ccc06e4d0 0x7f1ccc1ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 --2- 172.21.15.78:0/1945664428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ccc06e0b0 0x7f1ccc1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 >> 172.21.15.78:0/1945664428 conn(0x7f1ccc0c89a0 msgr2=0x7f1ccc06a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 shutdown_connections 2024-01-27T13:31:46.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.873+0000 7f1cd26ee640 1 -- 172.21.15.78:0/1945664428 wait complete. 2024-01-27T13:31:46.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new defebfaf-f581-43ba-a75e-8423d761d261 2 2024-01-27T13:31:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.983+0000 7f66c242b640 1 Processor -- start 2024-01-27T13:31:46.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.983+0000 7f66c242b640 1 -- start start 2024-01-27T13:31:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.984+0000 7f66c242b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66bc06f0b0 0x7f66bc0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.984+0000 7f66c242b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc0708c0 con 0x7f66bc1538a0 2024-01-27T13:31:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.984+0000 7f66c242b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc15ce30 con 0x7f66bc0c2850 2024-01-27T13:31:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.984+0000 7f66c242b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc15dc90 con 0x7f66bc06f0b0 2024-01-27T13:31:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.985+0000 7f66bb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f66bc06f0b0 0x7f66bc0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.985+0000 7f66bbfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f66bc1538a0 0x7f66bc06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.78:39128/0 (socket says 172.21.15.78:39128) 2024-01-27T13:31:46.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.985+0000 7f66bbfff640 1 -- 172.21.15.78:0/3034559743 learned_addr learned my addr 172.21.15.78:0/3034559743 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-01-27T13:31:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.987+0000 7f66bb7fe640 1 -- 172.21.15.78:0/3034559743 >> v1:172.21.15.78:6789/0 conn(0x7f66bc0c2850 legacy=0x7f66bc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.987+0000 7f66bb7fe640 1 -- 172.21.15.78:0/3034559743 >> v1:172.21.15.46:6789/0 conn(0x7f66bc1538a0 legacy=0x7f66bc06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.987+0000 7f66bb7fe640 1 -- 172.21.15.78:0/3034559743 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc15d110 con 0x7f66bc06f0b0 2024-01-27T13:31:46.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.989+0000 7f66bb7fe640 1 --2- 172.21.15.78:0/3034559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc06f0b0 0x7f66bc0c2310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0097a0 tx=0x7f66ac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec045d1874ea36d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:46.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66baffd640 1 -- 172.21.15.78:0/3034559743 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac031830 con 0x7f66bc06f0b0 2024-01-27T13:31:46.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66baffd640 1 -- 172.21.15.78:0/3034559743 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac031990 con 0x7f66bc06f0b0 2024-01-27T13:31:46.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66baffd640 1 -- 172.21.15.78:0/3034559743 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac031d20 con 0x7f66bc06f0b0 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 -- 172.21.15.78:0/3034559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc06f0b0 msgr2=0x7f66bc0c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 --2- 172.21.15.78:0/3034559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc06f0b0 0x7f66bc0c2310 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0097a0 tx=0x7f66ac02b8d0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 -- 172.21.15.78:0/3034559743 shutdown_connections 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 --2- 172.21.15.78:0/3034559743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc06f0b0 0x7f66bc0c2310 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 -- 172.21.15.78:0/3034559743 >> 172.21.15.78:0/3034559743 conn(0x7f66bc0c89a0 msgr2=0x7f66bc0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 -- 172.21.15.78:0/3034559743 shutdown_connections 2024-01-27T13:31:46.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.996+0000 7f66c242b640 1 -- 172.21.15.78:0/3034559743 wait complete. 2024-01-27T13:31:46.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 Processor -- start 2024-01-27T13:31:46.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 -- start start 2024-01-27T13:31:46.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66bc06f0b0 0x7f66bc1ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66bc0c2850 0x7f66bc0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 0x7f66bc0c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:46.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc1f05c0 con 0x7f66bc0c2850 2024-01-27T13:31:46.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc1efb40 con 0x7f66bc1538a0 2024-01-27T13:31:46.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.998+0000 7f66c242b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc0c6cb0 con 0x7f66bc06f0b0 2024-01-27T13:31:46.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.999+0000 7f66c09c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 0x7f66bc0c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.999+0000 7f66bb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66bc0c2850 0x7f66bc0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.999+0000 7f66bbfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66bc06f0b0 0x7f66bc1ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:46.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.999+0000 7f66c09c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 0x7f66bc0c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33352/0 (socket says 172.21.15.78:33352) 2024-01-27T13:31:46.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:46.999+0000 7f66c09c8640 1 -- 172.21.15.78:0/1613013016 learned_addr learned my addr 172.21.15.78:0/1613013016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:46.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.003+0000 7f66c09c8640 1 -- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66bc06f0b0 msgr2=0x7f66bc1ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.003+0000 7f66c09c8640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66bc06f0b0 0x7f66bc1ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.003+0000 7f66c09c8640 1 -- 172.21.15.78:0/1613013016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66bc0c2850 msgr2=0x7f66bc0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:46.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.003+0000 7f66c09c8640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66bc0c2850 0x7f66bc0cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:46.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.003+0000 7f66c09c8640 1 -- 172.21.15.78:0/1613013016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009400 con 0x7f66bc1538a0 2024-01-27T13:31:46.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.005+0000 7f66c09c8640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 0x7f66bc0c7140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f66b400c7e0 tx=0x7f66b400cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:47.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.008+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4003d80 con 0x7f66bc1538a0 2024-01-27T13:31:47.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.008+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b4005070 con 0x7f66bc1538a0 2024-01-27T13:31:47.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.008+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc0c8740 con 0x7f66bc1538a0 2024-01-27T13:31:47.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.008+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4005420 con 0x7f66bc1538a0 2024-01-27T13:31:47.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.008+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc1f0000 con 0x7f66bc1538a0 2024-01-27T13:31:47.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.009+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc074410 con 0x7f66bc1538a0 2024-01-27T13:31:47.020 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.027+0000 7fe472e45040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-27T13:31:47.050 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.057+0000 7f2368e17040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-27T13:31:47.159 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.167+0000 7fe472e45040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-27T13:31:47.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.222+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f66b4005580 con 0x7f66bc1538a0 2024-01-27T13:31:47.269 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.277+0000 7f2368e17040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-27T13:31:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.289+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f66b400aa00 con 0x7f66bc1538a0 2024-01-27T13:31:47.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.289+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f66b4017070 con 0x7f66bc1538a0 2024-01-27T13:31:47.290 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.298+0000 7fe472e45040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-27T13:31:47.337 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.345+0000 7fe472e45040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-27T13:31:47.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.361+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "defebfaf-f581-43ba-a75e-8423d761d261", "id": 2} v 0) v1 -- 0x7f66bc0c6df0 con 0x7f66bc1538a0 2024-01-27T13:31:47.403 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.410+0000 7f2368e17040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-27T13:31:47.438 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.446+0000 7fe472e45040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-27T13:31:47.453 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.461+0000 7f2368e17040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-27T13:31:47.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.521+0000 7f66b8ff9640 1 -- 172.21.15.78:0/1613013016 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "defebfaf-f581-43ba-a75e-8423d761d261", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66b400a5e0 con 0x7f66bc1538a0 2024-01-27T13:31:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:2 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 msgr2=0x7f66bc0c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 0x7f66bc0c7140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f66b400c7e0 tx=0x7f66b400cca0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 shutdown_connections 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66bc1538a0 0x7f66bc0c7140 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66bc0c2850 0x7f66bc0cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 --2- 172.21.15.78:0/1613013016 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f66bc06f0b0 0x7f66bc1ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 >> 172.21.15.78:0/1613013016 conn(0x7f66bc0c89a0 msgr2=0x7f66bc06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:47.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 shutdown_connections 2024-01-27T13:31:47.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.522+0000 7f66c242b640 1 -- 172.21.15.78:0/1613013016 wait complete. 2024-01-27T13:31:47.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new e34eb7f7-424e-4a37-bdfa-01a681f92a3d 3 2024-01-27T13:31:47.537 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.545+0000 7fe472e45040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-27T13:31:47.574 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.582+0000 7f2368e17040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 Processor -- start 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 -- start start 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac50159c80 0x7fac50156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac5015a060 0x7fac500c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac50157460 con 0x7fac5015a4d0 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5006ed60 con 0x7fac50159c80 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.634+0000 7fac5695a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5006e1e0 con 0x7fac5015a060 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.635+0000 7fac4f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac5015a060 0x7fac500c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.635+0000 7fac4ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fac50159c80 0x7fac50156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.635+0000 7fac4f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac5015a060 0x7fac500c1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42616/0 (socket says 172.21.15.78:42616) 2024-01-27T13:31:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.635+0000 7fac4f7fe640 1 -- 172.21.15.78:0/2945773577 learned_addr learned my addr 172.21.15.78:0/2945773577 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.637+0000 7fac4ffff640 1 -- 172.21.15.78:0/2945773577 >> v2:172.21.15.78:3300/0 conn(0x7fac5015a060 msgr2=0x7fac500c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.638+0000 7fac4ffff640 1 --2- 172.21.15.78:0/2945773577 >> v2:172.21.15.78:3300/0 conn(0x7fac5015a060 0x7fac500c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.638+0000 7fac4ffff640 1 -- 172.21.15.78:0/2945773577 >> v1:172.21.15.78:6789/0 conn(0x7fac5015a4d0 legacy=0x7fac50150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.638+0000 7fac4ffff640 1 -- 172.21.15.78:0/2945773577 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5006e4c0 con 0x7fac50159c80 2024-01-27T13:31:47.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.639+0000 7fac4ffff640 1 --2- 172.21.15.78:0/2945773577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac50156f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac400097d0 tx=0x7fac4002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2effa1cde5b1e30e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.643+0000 7fac4effd640 1 -- 172.21.15.78:0/2945773577 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40031780 con 0x7fac50159c80 2024-01-27T13:31:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.643+0000 7fac4effd640 1 -- 172.21.15.78:0/2945773577 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac400318e0 con 0x7fac50159c80 2024-01-27T13:31:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.643+0000 7fac4effd640 1 -- 172.21.15.78:0/2945773577 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40031c70 con 0x7fac50159c80 2024-01-27T13:31:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 -- 172.21.15.78:0/2945773577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 msgr2=0x7fac50156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 --2- 172.21.15.78:0/2945773577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac50156f20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fac400097d0 tx=0x7fac4002b820 comp rx=0 tx=0).stop 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 -- 172.21.15.78:0/2945773577 shutdown_connections 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 --2- 172.21.15.78:0/2945773577 >> v2:172.21.15.78:3300/0 conn(0x7fac5015a060 0x7fac500c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 --2- 172.21.15.78:0/2945773577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac50156f20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 -- 172.21.15.78:0/2945773577 >> 172.21.15.78:0/2945773577 conn(0x7fac500c89a0 msgr2=0x7fac500c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 -- 172.21.15.78:0/2945773577 shutdown_connections 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.644+0000 7fac5695a640 1 -- 172.21.15.78:0/2945773577 wait complete. 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.645+0000 7fac5695a640 1 Processor -- start 2024-01-27T13:31:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.645+0000 7fac5695a640 1 -- start start 2024-01-27T13:31:47.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.646+0000 7fac5695a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac5006a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.646+0000 7fac5695a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac5015a060 0x7fac50153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.646+0000 7fac5695a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac5015a4d0 0x7fac50153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.646+0000 7fac5695a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac501eda60 con 0x7fac50159c80 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.646+0000 7fac5695a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac501ed760 con 0x7fac5015a4d0 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.646+0000 7fac5695a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac500cb4a0 con 0x7fac5015a060 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.647+0000 7fac54ef7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac5015a4d0 0x7fac50153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.647+0000 7fac4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac5006a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.647+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac5015a060 0x7fac50153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.647+0000 7fac54ef7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac5015a4d0 0x7fac50153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42624/0 (socket says 172.21.15.78:42624) 2024-01-27T13:31:47.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.647+0000 7fac54ef7640 1 -- 172.21.15.78:0/2687554051 learned_addr learned my addr 172.21.15.78:0/2687554051 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.650+0000 7fac4ffff640 1 -- 172.21.15.78:0/2687554051 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac5015a060 msgr2=0x7fac50153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.650+0000 7fac4ffff640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac5015a060 0x7fac50153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.650+0000 7fac4ffff640 1 -- 172.21.15.78:0/2687554051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac5015a4d0 msgr2=0x7fac50153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.650+0000 7fac4ffff640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac5015a4d0 0x7fac50153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.650+0000 7fac4ffff640 1 -- 172.21.15.78:0/2687554051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009400 con 0x7fac50159c80 2024-01-27T13:31:47.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.652+0000 7fac4ffff640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac5006a980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fac40033000 tx=0x7fac400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.654+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40032820 con 0x7fac50159c80 2024-01-27T13:31:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.654+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac500cb760 con 0x7fac50159c80 2024-01-27T13:31:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.654+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac500ca020 con 0x7fac50159c80 2024-01-27T13:31:47.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.655+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac500c0fd0 con 0x7fac50159c80 2024-01-27T13:31:47.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.656+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac40005990 con 0x7fac50159c80 2024-01-27T13:31:47.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.656+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac40005d20 con 0x7fac50159c80 2024-01-27T13:31:47.676 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.684+0000 7f2368e17040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-27T13:31:47.682 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.690+0000 7fe472e45040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-27T13:31:47.725 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.733+0000 7fe472e45040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-27T13:31:47.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.759+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fac40006030 con 0x7fac50159c80 2024-01-27T13:31:47.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.759+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fac4004d920 con 0x7fac50159c80 2024-01-27T13:31:47.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.764+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fac500c0fd0 con 0x7fac50159c80 2024-01-27T13:31:47.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.841+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e34eb7f7-424e-4a37-bdfa-01a681f92a3d", "id": 3} v 0) v1 -- 0x7fac50074410 con 0x7fac50159c80 2024-01-27T13:31:47.838 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.846+0000 7f2368e17040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-27T13:31:47.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.878+0000 7fac4cff9640 1 -- 172.21.15.78:0/2687554051 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e34eb7f7-424e-4a37-bdfa-01a681f92a3d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac50157460 con 0x7fac50159c80 2024-01-27T13:31:47.870 INFO:teuthology.orchestra.run.smithi078.stdout:3 2024-01-27T13:31:47.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 msgr2=0x7fac5006a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac5006a980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fac40033000 tx=0x7fac400046c0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 shutdown_connections 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac5015a4d0 0x7fac50153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fac5015a060 0x7fac50153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 --2- 172.21.15.78:0/2687554051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac50159c80 0x7fac5006a980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 >> 172.21.15.78:0/2687554051 conn(0x7fac500c89a0 msgr2=0x7fac5006ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 shutdown_connections 2024-01-27T13:31:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.879+0000 7fac5695a640 1 -- 172.21.15.78:0/2687554051 wait complete. 2024-01-27T13:31:47.873 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:47.881+0000 7fe472e45040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-27T13:31:47.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new cf0fe755-2d81-4145-9088-bbf3ad06bd5d 4 2024-01-27T13:31:47.898 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:47.906+0000 7f2368e17040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-27T13:31:47.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.991+0000 7f28c65a4640 1 Processor -- start 2024-01-27T13:31:47.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.991+0000 7f28c65a4640 1 -- start start 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.992+0000 7f28c65a4640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28c0151650 0x7f28c0157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.992+0000 7f28c65a4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28c0151a30 0x7f28c00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.992+0000 7f28c65a4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c006a890 con 0x7f28c00c4c00 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.992+0000 7f28c65a4640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c00c7ac0 con 0x7f28c0151650 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.992+0000 7f28c65a4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c006b9b0 con 0x7f28c0151a30 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.993+0000 7f28bf7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28c0151a30 0x7f28c00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.993+0000 7f28bffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f28c0151650 0x7f28c0157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.993+0000 7f28bf7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28c0151a30 0x7f28c00cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42634/0 (socket says 172.21.15.78:42634) 2024-01-27T13:31:47.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.993+0000 7f28bf7fe640 1 -- 172.21.15.78:0/643500097 learned_addr learned my addr 172.21.15.78:0/643500097 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:47.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.995+0000 7f28bf7fe640 1 -- 172.21.15.78:0/643500097 >> v2:172.21.15.46:3300/0 conn(0x7f28c0151650 msgr2=0x7f28c0157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:47.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.995+0000 7f28bf7fe640 1 --2- 172.21.15.78:0/643500097 >> v2:172.21.15.46:3300/0 conn(0x7f28c0151650 0x7f28c0157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.995+0000 7f28bf7fe640 1 -- 172.21.15.78:0/643500097 >> v1:172.21.15.78:6789/0 conn(0x7f28c00c4c00 legacy=0x7f28c0071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:47.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.995+0000 7f28bf7fe640 1 -- 172.21.15.78:0/643500097 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c006ab50 con 0x7f28c0151a30 2024-01-27T13:31:47.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:47.998+0000 7f28bf7fe640 1 --2- 172.21.15.78:0/643500097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c0151a30 0x7f28c00cbd90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28c0066c00 tx=0x7f28b002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=263fd2cbb751bbdb server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:47.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.002+0000 7f28beffd640 1 -- 172.21.15.78:0/643500097 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0030860 con 0x7f28c0151a30 2024-01-27T13:31:47.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28beffd640 1 -- 172.21.15.78:0/643500097 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b00309c0 con 0x7f28c0151a30 2024-01-27T13:31:47.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28beffd640 1 -- 172.21.15.78:0/643500097 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0030d50 con 0x7f28c0151a30 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 -- 172.21.15.78:0/643500097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c0151a30 msgr2=0x7f28c00cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 --2- 172.21.15.78:0/643500097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c0151a30 0x7f28c00cbd90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28c0066c00 tx=0x7f28b002b9a0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 -- 172.21.15.78:0/643500097 shutdown_connections 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 --2- 172.21.15.78:0/643500097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c0151a30 0x7f28c00cbd90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 --2- 172.21.15.78:0/643500097 >> v2:172.21.15.46:3300/0 conn(0x7f28c0151650 0x7f28c0157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 -- 172.21.15.78:0/643500097 >> 172.21.15.78:0/643500097 conn(0x7f28c00c8620 msgr2=0x7f28c00cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 -- 172.21.15.78:0/643500097 shutdown_connections 2024-01-27T13:31:47.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.003+0000 7f28c65a4640 1 -- 172.21.15.78:0/643500097 wait complete. 2024-01-27T13:31:47.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.004+0000 7f28c65a4640 1 Processor -- start 2024-01-27T13:31:47.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 -- start start 2024-01-27T13:31:47.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28c00c4c00 0x7f28c01e2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28c0151650 0x7f28c014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 0x7f28c00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:47.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01effc0 con 0x7f28c00c4c00 2024-01-27T13:31:47.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01e2bb0 con 0x7f28c00c29f0 2024-01-27T13:31:47.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.005+0000 7f28c65a4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c01ef0d0 con 0x7f28c0151650 2024-01-27T13:31:47.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.006+0000 7f28c4b41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 0x7f28c00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.006+0000 7f28bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28c00c4c00 0x7f28c01e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.006+0000 7f28bf7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28c0151650 0x7f28c014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:47.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.006+0000 7f28c4b41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 0x7f28c00c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42642/0 (socket says 172.21.15.78:42642) 2024-01-27T13:31:47.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.006+0000 7f28c4b41640 1 -- 172.21.15.78:0/1845556411 learned_addr learned my addr 172.21.15.78:0/1845556411 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:48.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.009+0000 7f28c4b41640 1 -- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28c0151650 msgr2=0x7f28c014f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.009+0000 7f28c4b41640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28c0151650 0x7f28c014f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.009+0000 7f28c4b41640 1 -- 172.21.15.78:0/1845556411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28c00c4c00 msgr2=0x7f28c01e2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.009+0000 7f28c4b41640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28c00c4c00 0x7f28c01e2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.009+0000 7f28c4b41640 1 -- 172.21.15.78:0/1845556411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00094d0 con 0x7f28c00c29f0 2024-01-27T13:31:48.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.009+0000 7f28bffff640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28c00c4c00 0x7f28c01e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:31:48.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.011+0000 7f28c4b41640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 0x7f28c00c3c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28b800c7b0 tx=0x7f28b800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:48.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.016+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8003d80 con 0x7f28c00c29f0 2024-01-27T13:31:48.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.016+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8005070 con 0x7f28c00c29f0 2024-01-27T13:31:48.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.016+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c00cb1e0 con 0x7f28c00c29f0 2024-01-27T13:31:48.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.016+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8005420 con 0x7f28c00c29f0 2024-01-27T13:31:48.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.016+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c01ef620 con 0x7f28c00c29f0 2024-01-27T13:31:48.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.017+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c0074410 con 0x7f28c00c29f0 2024-01-27T13:31:48.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.021+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f28b8005580 con 0x7f28c00c29f0 2024-01-27T13:31:48.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.021+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f28b801b8c0 con 0x7f28c00c29f0 2024-01-27T13:31:48.053 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:48.061+0000 7f2368e17040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-27T13:31:48.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.115+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f28b8017070 con 0x7f28c00c29f0 2024-01-27T13:31:48.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.187+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf0fe755-2d81-4145-9088-bbf3ad06bd5d", "id": 4} v 0) v1 -- 0x7f28c0157cc0 con 0x7f28c00c29f0 2024-01-27T13:31:48.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.255+0000 7f28bcff9640 1 -- 172.21.15.78:0/1845556411 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf0fe755-2d81-4145-9088-bbf3ad06bd5d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28b801b3b0 con 0x7f28c00c29f0 2024-01-27T13:31:48.249 INFO:teuthology.orchestra.run.smithi078.stdout:4 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 msgr2=0x7f28c00c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 0x7f28c00c3c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28b800c7b0 tx=0x7f28b800cc70 comp rx=0 tx=0).stop 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 shutdown_connections 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c00c29f0 0x7f28c00c3c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f28c0151650 0x7f28c014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 --2- 172.21.15.78:0/1845556411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f28c00c4c00 0x7f28c01e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 >> 172.21.15.78:0/1845556411 conn(0x7f28c00c8620 msgr2=0x7f28c00c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 shutdown_connections 2024-01-27T13:31:48.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.256+0000 7f28c65a4640 1 -- 172.21.15.78:0/1845556411 wait complete. 2024-01-27T13:31:48.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 83756c79-ff37-4eb9-9005-63307bec2a30 5 2024-01-27T13:31:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.408+0000 7faede490640 1 Processor -- start 2024-01-27T13:31:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.408+0000 7faede490640 1 -- start start 2024-01-27T13:31:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.409+0000 7faede490640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faed80c7470 0x7faed8159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.409+0000 7faede490640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed8159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.409+0000 7faede490640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed815a8c0 con 0x7faed80c7090 2024-01-27T13:31:48.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.409+0000 7faede490640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80700b0 con 0x7faed80c7470 2024-01-27T13:31:48.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.409+0000 7faede490640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed815a5e0 con 0x7faed80c7920 2024-01-27T13:31:48.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.409+0000 7faedca2d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed8159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.410+0000 7faedca2d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed8159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:53236/0 (socket says 172.21.15.78:53236) 2024-01-27T13:31:48.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.410+0000 7faedca2d640 1 -- 172.21.15.78:0/1002137483 learned_addr learned my addr 172.21.15.78:0/1002137483 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:48.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.410+0000 7faed77fe640 1 --2- 172.21.15.78:0/1002137483 >> v2:172.21.15.46:3300/0 conn(0x7faed80c7470 0x7faed8159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.412+0000 7faedca2d640 1 -- 172.21.15.78:0/1002137483 >> v2:172.21.15.46:3300/0 conn(0x7faed80c7470 msgr2=0x7faed8159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:48.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.412+0000 7faedca2d640 1 --2- 172.21.15.78:0/1002137483 >> v2:172.21.15.46:3300/0 conn(0x7faed80c7470 0x7faed8159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.412+0000 7faedca2d640 1 -- 172.21.15.78:0/1002137483 >> v1:172.21.15.46:6789/0 conn(0x7faed80c7090 legacy=0x7faed806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.412+0000 7faedca2d640 1 -- 172.21.15.78:0/1002137483 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80c0fd0 con 0x7faed80c7920 2024-01-27T13:31:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.413+0000 7faedca2d640 1 --2- 172.21.15.78:0/1002137483 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed8159f90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e50 tx=0x7faed002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e1fc9f9f9c563c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:48.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.417+0000 7faed6ffd640 1 -- 172.21.15.78:0/1002137483 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed002cb90 con 0x7faed80c7920 2024-01-27T13:31:48.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.417+0000 7faed6ffd640 1 -- 172.21.15.78:0/1002137483 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed002ccf0 con 0x7faed80c7920 2024-01-27T13:31:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.417+0000 7faed6ffd640 1 -- 172.21.15.78:0/1002137483 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0034610 con 0x7faed80c7920 2024-01-27T13:31:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 -- 172.21.15.78:0/1002137483 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 msgr2=0x7faed8159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 --2- 172.21.15.78:0/1002137483 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed8159f90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e50 tx=0x7faed002bff0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 -- 172.21.15.78:0/1002137483 shutdown_connections 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 --2- 172.21.15.78:0/1002137483 >> v2:172.21.15.46:3300/0 conn(0x7faed80c7470 0x7faed8159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 --2- 172.21.15.78:0/1002137483 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed8159f90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 -- 172.21.15.78:0/1002137483 >> 172.21.15.78:0/1002137483 conn(0x7faed80c8a10 msgr2=0x7faed80c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 -- 172.21.15.78:0/1002137483 shutdown_connections 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.418+0000 7faede490640 1 -- 172.21.15.78:0/1002137483 wait complete. 2024-01-27T13:31:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.419+0000 7faede490640 1 Processor -- start 2024-01-27T13:31:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.419+0000 7faede490640 1 -- start start 2024-01-27T13:31:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faede490640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faed80c7090 0x7faed813dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faede490640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c7470 0x7faed81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faede490640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed80cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faede490640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed813e1d0 con 0x7faed80c7470 2024-01-27T13:31:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faede490640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed8157e10 con 0x7faed80c7090 2024-01-27T13:31:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faede490640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed81520f0 con 0x7faed80c7920 2024-01-27T13:31:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.420+0000 7faedca2d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed80cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.421+0000 7faed7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faed80c7090 0x7faed813dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.421+0000 7faed77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c7470 0x7faed81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.421+0000 7faedca2d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed80cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:53250/0 (socket says 172.21.15.78:53250) 2024-01-27T13:31:48.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.421+0000 7faedca2d640 1 -- 172.21.15.78:0/4183100627 learned_addr learned my addr 172.21.15.78:0/4183100627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.424+0000 7faedca2d640 1 -- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faed80c7090 msgr2=0x7faed813dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.424+0000 7faedca2d640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faed80c7090 0x7faed813dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.424+0000 7faedca2d640 1 -- 172.21.15.78:0/4183100627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c7470 msgr2=0x7faed81516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.424+0000 7faedca2d640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c7470 0x7faed81516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.424+0000 7faedca2d640 1 -- 172.21.15.78:0/4183100627 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0009b30 con 0x7faed80c7920 2024-01-27T13:31:48.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.426+0000 7faedca2d640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed80cae60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e50 tx=0x7faed0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.430+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0040670 con 0x7faed80c7920 2024-01-27T13:31:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.430+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0040810 con 0x7faed80c7920 2024-01-27T13:31:48.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.430+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed81f0f70 con 0x7faed80c7920 2024-01-27T13:31:48.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.430+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0040bc0 con 0x7faed80c7920 2024-01-27T13:31:48.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.430+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed8158340 con 0x7faed80c7920 2024-01-27T13:31:48.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.431+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed81f1280 con 0x7faed80c7920 2024-01-27T13:31:48.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.433+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7faed00527c0 con 0x7faed80c7920 2024-01-27T13:31:48.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.433+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7faed003ea40 con 0x7faed80c7920 2024-01-27T13:31:48.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.533+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7faed0044020 con 0x7faed80c7920 2024-01-27T13:31:48.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.603+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83756c79-ff37-4eb9-9005-63307bec2a30", "id": 5} v 0) v1 -- 0x7faed8074410 con 0x7faed80c7920 2024-01-27T13:31:48.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.685+0000 7faed4ff9640 1 -- 172.21.15.78:0/4183100627 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83756c79-ff37-4eb9-9005-63307bec2a30", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faed00570b0 con 0x7faed80c7920 2024-01-27T13:31:48.678 INFO:teuthology.orchestra.run.smithi078.stdout:5 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 msgr2=0x7faed80cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed80cae60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faed0009e50 tx=0x7faed0004a40 comp rx=0 tx=0).stop 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 shutdown_connections 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faed80c7920 0x7faed80cae60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faed80c7470 0x7faed81516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 --2- 172.21.15.78:0/4183100627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faed80c7090 0x7faed813dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 >> 172.21.15.78:0/4183100627 conn(0x7faed80c8a10 msgr2=0x7faed8140b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:48.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 shutdown_connections 2024-01-27T13:31:48.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.686+0000 7faede490640 1 -- 172.21.15.78:0/4183100627 wait complete. 2024-01-27T13:31:48.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 7cd312b5-647e-40ed-a7e8-c128e278cfea 6 2024-01-27T13:31:48.695 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:48.702+0000 7fe472e45040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-27T13:31:48.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.799+0000 7f11f04cf640 1 Processor -- start 2024-01-27T13:31:48.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.799+0000 7f11f04cf640 1 -- start start 2024-01-27T13:31:48.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11f04cf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e8151840 0x7f11e80c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11f04cf640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80ca370 con 0x7f11e80c8e50 2024-01-27T13:31:48.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11f04cf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80ca650 con 0x7f11e8158290 2024-01-27T13:31:48.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11f04cf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e81575c0 con 0x7f11e8151840 2024-01-27T13:31:48.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11ee26b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e8151840 0x7f11e80c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11eda6a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f11e8158290 0x7f11e80663a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57394/0 (socket says 172.21.15.78:57394) 2024-01-27T13:31:48.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.800+0000 7f11eda6a640 1 -- 172.21.15.78:0/117797339 learned_addr learned my addr 172.21.15.78:0/117797339 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-01-27T13:31:48.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.803+0000 7f11ee26b640 1 -- 172.21.15.78:0/117797339 >> v1:172.21.15.78:6789/0 conn(0x7f11e8158290 legacy=0x7f11e80663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.803+0000 7f11ee26b640 1 -- 172.21.15.78:0/117797339 >> v1:172.21.15.46:6789/0 conn(0x7f11e80c8e50 legacy=0x7f11e8161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:48.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.803+0000 7f11ee26b640 1 -- 172.21.15.78:0/117797339 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e81577b0 con 0x7f11e8151840 2024-01-27T13:31:48.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.804+0000 7f11ee26b640 1 --2- 172.21.15.78:0/117797339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e8151840 0x7f11e80c8210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11e40097d0 tx=0x7f11e402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1dfeb4ea026878c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:48.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.808+0000 7f11ed269640 1 -- 172.21.15.78:0/117797339 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4031800 con 0x7f11e8151840 2024-01-27T13:31:48.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.808+0000 7f11ed269640 1 -- 172.21.15.78:0/117797339 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e4031960 con 0x7f11e8151840 2024-01-27T13:31:48.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.808+0000 7f11ed269640 1 -- 172.21.15.78:0/117797339 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4031cf0 con 0x7f11e8151840 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 -- 172.21.15.78:0/117797339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e8151840 msgr2=0x7f11e80c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 --2- 172.21.15.78:0/117797339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e8151840 0x7f11e80c8210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11e40097d0 tx=0x7f11e402b8a0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 -- 172.21.15.78:0/117797339 shutdown_connections 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 --2- 172.21.15.78:0/117797339 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e8151840 0x7f11e80c8210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 -- 172.21.15.78:0/117797339 >> 172.21.15.78:0/117797339 conn(0x7f11e806af40 msgr2=0x7f11e806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 -- 172.21.15.78:0/117797339 shutdown_connections 2024-01-27T13:31:48.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.809+0000 7f11f04cf640 1 -- 172.21.15.78:0/117797339 wait complete. 2024-01-27T13:31:48.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.811+0000 7f11f04cf640 1 Processor -- start 2024-01-27T13:31:48.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.811+0000 7f11f04cf640 1 -- start start 2024-01-27T13:31:48.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.812+0000 7f11f04cf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e80c8e50 0x7f11e8159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.812+0000 7f11f04cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e8151840 0x7f11e81565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.812+0000 7f11f04cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 0x7f11e8145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:48.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.812+0000 7f11f04cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80c60b0 con 0x7f11e8151840 2024-01-27T13:31:48.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.812+0000 7f11f04cf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80c5af0 con 0x7f11e8158290 2024-01-27T13:31:48.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.812+0000 7f11f04cf640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80c5dd0 con 0x7f11e80c8e50 2024-01-27T13:31:48.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.815+0000 7f11eea6c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 0x7f11e8145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.816+0000 7f11eda6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e8151840 0x7f11e81565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.816+0000 7f11eea6c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 0x7f11e8145e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42656/0 (socket says 172.21.15.78:42656) 2024-01-27T13:31:48.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.816+0000 7f11eea6c640 1 -- 172.21.15.78:0/1048755109 learned_addr learned my addr 172.21.15.78:0/1048755109 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:48.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.816+0000 7f11ee26b640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e80c8e50 0x7f11e8159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:48.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.820+0000 7f11eea6c640 1 -- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e80c8e50 msgr2=0x7f11e8159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.820+0000 7f11eea6c640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e80c8e50 0x7f11e8159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.820+0000 7f11eea6c640 1 -- 172.21.15.78:0/1048755109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e8151840 msgr2=0x7f11e81565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:48.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.820+0000 7f11eea6c640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e8151840 0x7f11e81565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:48.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.820+0000 7f11eea6c640 1 -- 172.21.15.78:0/1048755109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4009400 con 0x7f11e8158290 2024-01-27T13:31:48.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.822+0000 7f11eea6c640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 0x7f11e8145e90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11e000b990 tx=0x7f11e000be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:48.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.850+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e000cba0 con 0x7f11e8158290 2024-01-27T13:31:48.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.850+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e8151da0 con 0x7f11e8158290 2024-01-27T13:31:48.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.850+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e80cc1e0 con 0x7f11e8158290 2024-01-27T13:31:48.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.851+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e80cc420 con 0x7f11e8158290 2024-01-27T13:31:48.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.856+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e00098d0 con 0x7f11e8158290 2024-01-27T13:31:48.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.856+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e001e440 con 0x7f11e8158290 2024-01-27T13:31:48.922 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:48.929+0000 7f2368e17040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-27T13:31:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.958+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f11e001e6a0 con 0x7f11e8158290 2024-01-27T13:31:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.958+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f11e0014b90 con 0x7f11e8158290 2024-01-27T13:31:48.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:48.958+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f11e80cc420 con 0x7f11e8158290 2024-01-27T13:31:48.979 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:48.987+0000 7fe472e45040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-27T13:31:49.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.031+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7cd312b5-647e-40ed-a7e8-c128e278cfea", "id": 6} v 0) v1 -- 0x7f11e8074410 con 0x7f11e8158290 2024-01-27T13:31:49.031 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:49.039+0000 7fe472e45040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-27T13:31:49.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.108+0000 7f11deffd640 1 -- 172.21.15.78:0/1048755109 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cd312b5-647e-40ed-a7e8-c128e278cfea", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11e0023060 con 0x7f11e8158290 2024-01-27T13:31:49.101 INFO:teuthology.orchestra.run.smithi078.stdout:6 2024-01-27T13:31:49.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 msgr2=0x7f11e8145e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:49.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 0x7f11e8145e90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11e000b990 tx=0x7f11e000be50 comp rx=0 tx=0).stop 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 shutdown_connections 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e8158290 0x7f11e8145e90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11e8151840 0x7f11e81565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 --2- 172.21.15.78:0/1048755109 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f11e80c8e50 0x7f11e8159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 >> 172.21.15.78:0/1048755109 conn(0x7f11e806af40 msgr2=0x7f11e80c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 shutdown_connections 2024-01-27T13:31:49.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.110+0000 7f11f04cf640 1 -- 172.21.15.78:0/1048755109 wait complete. 2024-01-27T13:31:49.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd new 6f935d8e-c7e4-4899-9de2-94a36b6d2357 7 2024-01-27T13:31:49.137 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:49.144+0000 7fe472e45040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-27T13:31:49.211 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:49.219+0000 7f2368e17040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-27T13:31:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.224+0000 7fc71f25d640 1 Processor -- start 2024-01-27T13:31:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.224+0000 7fc71f25d640 1 -- start start 2024-01-27T13:31:49.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.225+0000 7fc71f25d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7180cbc80 0x7fc7181651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.225+0000 7fc71f25d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7180c3f90 con 0x7fc718153a70 2024-01-27T13:31:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.225+0000 7fc71f25d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71806c060 con 0x7fc7180c9a50 2024-01-27T13:31:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.225+0000 7fc71f25d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180c9e70 con 0x7fc7180cbc80 2024-01-27T13:31:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.226+0000 7fc71d7fa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7180cbc80 0x7fc7181651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.226+0000 7fc717fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc7180c9a50 0x7fc7180cb570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57402/0 (socket says 172.21.15.78:57402) 2024-01-27T13:31:49.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.226+0000 7fc717fff640 1 -- 172.21.15.78:0/2983107677 learned_addr learned my addr 172.21.15.78:0/2983107677 (peer_addr_for_me v1:172.21.15.78:0/0) 2024-01-27T13:31:49.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.228+0000 7fc71d7fa640 1 -- 172.21.15.78:0/2983107677 >> v1:172.21.15.78:6789/0 conn(0x7fc7180c9a50 legacy=0x7fc7180cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:49.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.228+0000 7fc71d7fa640 1 -- 172.21.15.78:0/2983107677 >> v1:172.21.15.46:6789/0 conn(0x7fc718153a70 legacy=0x7fc71806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:49.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.228+0000 7fc71d7fa640 1 -- 172.21.15.78:0/2983107677 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180670d0 con 0x7fc7180cbc80 2024-01-27T13:31:49.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.230+0000 7fc71d7fa640 1 --2- 172.21.15.78:0/2983107677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7180cbc80 0x7fc7181651c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097d0 tx=0x7fc70802b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7bd0d0cda56366b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:49.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.234+0000 7fc7177fe640 1 -- 172.21.15.78:0/2983107677 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708031770 con 0x7fc7180cbc80 2024-01-27T13:31:49.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.234+0000 7fc7177fe640 1 -- 172.21.15.78:0/2983107677 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7080318d0 con 0x7fc7180cbc80 2024-01-27T13:31:49.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.234+0000 7fc7177fe640 1 -- 172.21.15.78:0/2983107677 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708031c60 con 0x7fc7180cbc80 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.234+0000 7fc71f25d640 1 -- 172.21.15.78:0/2983107677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7180cbc80 msgr2=0x7fc7181651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.234+0000 7fc71f25d640 1 --2- 172.21.15.78:0/2983107677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7180cbc80 0x7fc7181651c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097d0 tx=0x7fc70802b810 comp rx=0 tx=0).stop 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.235+0000 7fc71f25d640 1 -- 172.21.15.78:0/2983107677 shutdown_connections 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.235+0000 7fc71f25d640 1 --2- 172.21.15.78:0/2983107677 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc7180cbc80 0x7fc7181651c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.235+0000 7fc71f25d640 1 -- 172.21.15.78:0/2983107677 >> 172.21.15.78:0/2983107677 conn(0x7fc71808b600 msgr2=0x7fc7180663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.235+0000 7fc71f25d640 1 -- 172.21.15.78:0/2983107677 shutdown_connections 2024-01-27T13:31:49.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.235+0000 7fc71f25d640 1 -- 172.21.15.78:0/2983107677 wait complete. 2024-01-27T13:31:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.236+0000 7fc71f25d640 1 Processor -- start 2024-01-27T13:31:49.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.236+0000 7fc71f25d640 1 -- start start 2024-01-27T13:31:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71f25d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7180c9a50 0x7fc7181ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71f25d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7180cbc80 0x7fc71815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71f25d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 0x7fc71815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71f25d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181f0530 con 0x7fc7180cbc80 2024-01-27T13:31:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71f25d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181efab0 con 0x7fc7180c9a50 2024-01-27T13:31:49.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71f25d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181547f0 con 0x7fc718153a70 2024-01-27T13:31:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71d7fa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 0x7fc71815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.237+0000 7fc71cff9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7180c9a50 0x7fc7181ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.238+0000 7fc71d7fa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 0x7fc71815b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.78:53270/0 (socket says 172.21.15.78:53270) 2024-01-27T13:31:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.238+0000 7fc71d7fa640 1 -- 172.21.15.78:0/1956038645 learned_addr learned my addr 172.21.15.78:0/1956038645 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-01-27T13:31:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.241+0000 7fc71d7fa640 1 -- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7180c9a50 msgr2=0x7fc7181ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.241+0000 7fc71d7fa640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7180c9a50 0x7fc7181ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.241+0000 7fc71d7fa640 1 -- 172.21.15.78:0/1956038645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7180cbc80 msgr2=0x7fc71815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.241+0000 7fc71d7fa640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7180cbc80 0x7fc71815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.241+0000 7fc71d7fa640 1 -- 172.21.15.78:0/1956038645 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708009400 con 0x7fc718153a70 2024-01-27T13:31:49.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.243+0000 7fc71d7fa640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 0x7fc71815b390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097d0 tx=0x7fc7080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.246+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708032810 con 0x7fc718153a70 2024-01-27T13:31:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.246+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708032990 con 0x7fc718153a70 2024-01-27T13:31:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.246+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7181efc90 con 0x7fc718153a70 2024-01-27T13:31:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.246+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708032d40 con 0x7fc718153a70 2024-01-27T13:31:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.247+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7181f0250 con 0x7fc718153a70 2024-01-27T13:31:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.247+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc718067330 con 0x7fc718153a70 2024-01-27T13:31:49.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.250+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc708005990 con 0x7fc718153a70 2024-01-27T13:31:49.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.250+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc7080067d0 con 0x7fc718153a70 2024-01-27T13:31:49.266 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:49.274+0000 7f2368e17040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-27T13:31:49.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.350+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fc708005c40 con 0x7fc718153a70 2024-01-27T13:31:49.378 INFO:tasks.ceph.mgr.x.smithi078.stderr:2024-01-27T13:31:49.386+0000 7f2368e17040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-27T13:31:49.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.422+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6f935d8e-c7e4-4899-9de2-94a36b6d2357", "id": 7} v 0) v1 -- 0x7fc718074410 con 0x7fc718153a70 2024-01-27T13:31:49.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.557+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mgrmap(e 2) v1 ==== 44628+0+0 (secure 0 0 0) 0x7fc708005e90 con 0x7fc718153a70 2024-01-27T13:31:49.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.975+0000 7fc7157fa640 1 -- 172.21.15.78:0/1956038645 <== mon.2 v2:172.21.15.78:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f935d8e-c7e4-4899-9de2-94a36b6d2357", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc7080302c0 con 0x7fc718153a70 2024-01-27T13:31:49.967 INFO:teuthology.orchestra.run.smithi078.stdout:7 2024-01-27T13:31:49.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 msgr2=0x7fc71815b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 0x7fc71815b390 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc7080097d0 tx=0x7fc7080046c0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 shutdown_connections 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc718153a70 0x7fc71815b390 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc7180cbc80 0x7fc71815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 --2- 172.21.15.78:0/1956038645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7180c9a50 0x7fc7181ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 >> 172.21.15.78:0/1956038645 conn(0x7fc71808b600 msgr2=0x7fc718150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 shutdown_connections 2024-01-27T13:31:49.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-01-27T13:31:49.976+0000 7fc71f25d640 1 -- 172.21.15.78:0/1956038645 wait complete. 2024-01-27T13:31:49.978 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-27T13:31:49.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-01-27T13:31:49.981 INFO:tasks.ceph.osd.0:Started 2024-01-27T13:31:49.981 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-27T13:31:49.981 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-01-27T13:31:49.983 INFO:tasks.ceph.osd.1:Started 2024-01-27T13:31:49.984 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-27T13:31:49.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-01-27T13:31:49.986 INFO:tasks.ceph.osd.2:Started 2024-01-27T13:31:49.986 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-27T13:31:49.986 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-01-27T13:31:49.988 INFO:tasks.ceph.osd.3:Started 2024-01-27T13:31:49.988 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-27T13:31:49.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-01-27T13:31:49.990 INFO:tasks.ceph.osd.4:Started 2024-01-27T13:31:49.990 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-27T13:31:49.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-01-27T13:31:49.993 INFO:tasks.ceph.osd.5:Started 2024-01-27T13:31:49.993 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-27T13:31:49.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-01-27T13:31:49.995 INFO:tasks.ceph.osd.6:Started 2024-01-27T13:31:49.995 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-27T13:31:49.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-01-27T13:31:49.997 INFO:tasks.ceph.osd.7:Started 2024-01-27T13:31:49.998 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:31:50.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.131+0000 7fb461ea2640 1 Processor -- start 2024-01-27T13:31:50.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.131+0000 7fb461ea2640 1 -- start start 2024-01-27T13:31:50.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.132+0000 7fb461ea2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb45c1538a0 0x7fb45c06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:50.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.132+0000 7fb461ea2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb45c06e0b0 0x7fb45c0c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:50.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.132+0000 7fb461ea2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:50.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.132+0000 7fb461ea2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c15dc90 con 0x7fb45c1538a0 2024-01-27T13:31:50.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.132+0000 7fb461ea2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c1596c0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.132+0000 7fb461ea2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0708c0 con 0x7fb45c06e4d0 2024-01-27T13:31:50.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.134+0000 7fb45bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:50.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.134+0000 7fb45bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c0c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:45152/0 (socket says 172.21.15.46:45152) 2024-01-27T13:31:50.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.134+0000 7fb45bfff640 1 -- 172.21.15.46:0/2566213178 learned_addr learned my addr 172.21.15.46:0/2566213178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:50.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.165+0000 7fb45affd640 1 --2- 172.21.15.46:0/2566213178 >> v2:172.21.15.78:3300/0 conn(0x7fb45c06e0b0 0x7fb45c0c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.169+0000 7fb45affd640 1 -- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 msgr2=0x7fb45c0c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.169+0000 7fb45affd640 1 --2- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c0c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.169+0000 7fb45affd640 1 -- 172.21.15.46:0/2566213178 >> v2:172.21.15.46:3300/0 conn(0x7fb45c1538a0 msgr2=0x7fb45c06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.169+0000 7fb45affd640 1 --2- 172.21.15.46:0/2566213178 >> v2:172.21.15.46:3300/0 conn(0x7fb45c1538a0 0x7fb45c06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.169+0000 7fb45affd640 1 -- 172.21.15.46:0/2566213178 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c15ce30 con 0x7fb45c06e0b0 2024-01-27T13:31:50.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.172+0000 7fb45affd640 1 --2- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c0c2310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb45c06ca30 tx=0x7fb44c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7eb3b0069330914 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.179+0000 7fb45a7fc640 1 -- 172.21.15.46:0/2566213178 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c02e070 con 0x7fb45c06e0b0 2024-01-27T13:31:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.179+0000 7fb45a7fc640 1 -- 172.21.15.46:0/2566213178 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c0315a0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.179+0000 7fb45a7fc640 1 -- 172.21.15.46:0/2566213178 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c031930 con 0x7fb45c06e0b0 2024-01-27T13:31:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.179+0000 7fb461ea2640 1 -- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 msgr2=0x7fb45c0c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.179+0000 7fb461ea2640 1 --2- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c0c2310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb45c06ca30 tx=0x7fb44c02b840 comp rx=0 tx=0).stop 2024-01-27T13:31:50.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 -- 172.21.15.46:0/2566213178 shutdown_connections 2024-01-27T13:31:50.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 --2- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c0c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 --2- 172.21.15.46:0/2566213178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c0c2310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 --2- 172.21.15.46:0/2566213178 >> v2:172.21.15.46:3300/0 conn(0x7fb45c1538a0 0x7fb45c06f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 -- 172.21.15.46:0/2566213178 >> 172.21.15.46:0/2566213178 conn(0x7fb45c0c89a0 msgr2=0x7fb45c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:50.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 -- 172.21.15.46:0/2566213178 shutdown_connections 2024-01-27T13:31:50.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.180+0000 7fb461ea2640 1 -- 172.21.15.46:0/2566213178 wait complete. 2024-01-27T13:31:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.181+0000 7fb461ea2640 1 Processor -- start 2024-01-27T13:31:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.181+0000 7fb461ea2640 1 -- start start 2024-01-27T13:31:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb461ea2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:50.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb461ea2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c1f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb461ea2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb45c1538a0 0x7fb45c1eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb461ea2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0c7250 con 0x7fb45c1538a0 2024-01-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb461ea2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1f0460 con 0x7fb45c06e0b0 2024-01-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb461ea2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1f2a00 con 0x7fb45c06e4d0 2024-01-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:50.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c1ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:37986/0 (socket says 172.21.15.46:37986) 2024-01-27T13:31:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.182+0000 7fb45b7fe640 1 -- 172.21.15.46:0/3972308572 learned_addr learned my addr 172.21.15.46:0/3972308572 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:50.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.184+0000 7fb45affd640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c1f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.185+0000 7fb45b7fe640 1 -- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 msgr2=0x7fb45c1f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.185+0000 7fb45b7fe640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c1f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.185+0000 7fb45b7fe640 1 -- 172.21.15.46:0/3972308572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb45c1538a0 msgr2=0x7fb45c1eff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:50.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.185+0000 7fb45b7fe640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb45c1538a0 0x7fb45c1eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.186+0000 7fb45b7fe640 1 -- 172.21.15.46:0/3972308572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009400 con 0x7fb45c06e0b0 2024-01-27T13:31:50.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.188+0000 7fb45b7fe640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c1ef490 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b440 tx=0x7fb44400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.191+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444011890 con 0x7fb45c06e0b0 2024-01-27T13:31:50.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.191+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4440119f0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.191+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0c73f0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.191+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb444011da0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.191+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0c7990 con 0x7fb45c06e0b0 2024-01-27T13:31:50.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.192+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c074410 con 0x7fb45c06e0b0 2024-01-27T13:31:50.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.202+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 2) v1 ==== 44628+0+0 (secure 0 0 0) 0x7fb44401a400 con 0x7fb45c06e0b0 2024-01-27T13:31:50.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.203+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb444019570 con 0x7fb45c06e0b0 2024-01-27T13:31:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.303+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fb4440103e0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.365+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb45c0c0fd0 con 0x7fb45c06e0b0 2024-01-27T13:31:50.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.411+0000 7fb453fff640 1 -- 172.21.15.46:0/3972308572 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb444028070 con 0x7fb45c06e0b0 2024-01-27T13:31:50.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:31:50.404 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:31:49.577137+0000","last_up_change":"0.000000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:31:50.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 msgr2=0x7fb45c1ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:50.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c1ef490 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b440 tx=0x7fb44400b900 comp rx=0 tx=0).stop 2024-01-27T13:31:50.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 shutdown_connections 2024-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb45c1538a0 0x7fb45c1eff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb45c06e4d0 0x7fb45c1f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 --2- 172.21.15.46:0/3972308572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb45c06e0b0 0x7fb45c1ef490 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 >> 172.21.15.46:0/3972308572 conn(0x7fb45c0c89a0 msgr2=0x7fb45c0c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.412+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 shutdown_connections 2024-01-27T13:31:50.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:50.413+0000 7fb461ea2640 1 -- 172.21.15.46:0/3972308572 wait complete. 2024-01-27T13:31:50.415 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-27T13:31:50.415 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-27T13:31:50.599 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T13:31:50.607+0000 7f8c970d9640 -1 Falling back to public interface 2024-01-27T13:31:50.617 INFO:tasks.ceph.osd.6.smithi078.stderr:2024-01-27T13:31:50.624+0000 7f9561a0c640 -1 Falling back to public interface 2024-01-27T13:31:50.621 INFO:tasks.ceph.osd.4.smithi078.stderr:2024-01-27T13:31:50.628+0000 7f4c3b00c640 -1 Falling back to public interface 2024-01-27T13:31:50.621 INFO:tasks.ceph.osd.7.smithi078.stderr:2024-01-27T13:31:50.628+0000 7fce56411640 -1 Falling back to public interface 2024-01-27T13:31:50.680 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T13:31:50.687+0000 7ff641e0d640 -1 Falling back to public interface 2024-01-27T13:31:50.683 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T13:31:50.691+0000 7f2fbd468640 -1 Falling back to public interface 2024-01-27T13:31:50.707 INFO:tasks.ceph.osd.5.smithi078.stderr:2024-01-27T13:31:50.712+0000 7fd234c19640 -1 Falling back to public interface 2024-01-27T13:31:50.718 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T13:31:50.725+0000 7fae974ce640 -1 Falling back to public interface 2024-01-27T13:31:50.871 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:50.879+0000 7fe4141f0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-27T13:31:50.897 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T13:31:50.904+0000 7fe4141f0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-27T13:31:51.220 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-27T13:31:51.320 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.325+0000 7f3b6a12d640 1 Processor -- start 2024-01-27T13:31:51.320 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.325+0000 7f3b6a12d640 1 -- start start 2024-01-27T13:31:51.320 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.326+0000 7f3b6a12d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b640ca390 0x7f3b64165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:51.320 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.326+0000 7f3b6a12d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b640c6c70 con 0x7f3b640cc590 2024-01-27T13:31:51.321 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.326+0000 7f3b6a12d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6415a540 con 0x7f3b64153fd0 2024-01-27T13:31:51.321 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.326+0000 7f3b6a12d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6415a9d0 con 0x7f3b640ca390 2024-01-27T13:31:51.321 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.326+0000 7f3b63fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b640ca390 0x7f3b64165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:51.321 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.327+0000 7f3b63fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b640ca390 0x7f3b64165340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:37998/0 (socket says 172.21.15.46:37998) 2024-01-27T13:31:51.321 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.327+0000 7f3b63fff640 1 -- 172.21.15.46:0/4164053437 learned_addr learned my addr 172.21.15.46:0/4164053437 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:51.322 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.329+0000 7f3b63fff640 1 -- 172.21.15.46:0/4164053437 >> v1:172.21.15.78:6789/0 conn(0x7f3b64153fd0 legacy=0x7f3b6415cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.322 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.329+0000 7f3b63fff640 1 -- 172.21.15.46:0/4164053437 >> v1:172.21.15.46:6789/0 conn(0x7f3b640cc590 legacy=0x7f3b640cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.322 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.329+0000 7f3b63fff640 1 -- 172.21.15.46:0/4164053437 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640c6990 con 0x7f3b640ca390 2024-01-27T13:31:51.326 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.334+0000 7f3b63fff640 1 --2- 172.21.15.46:0/4164053437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b640ca390 0x7f3b64165340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009e50 tx=0x7f3b5c02c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7abdff3eb4b51b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:51.329 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.337+0000 7f3b627fc640 1 -- 172.21.15.46:0/4164053437 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c02cbb0 con 0x7f3b640ca390 2024-01-27T13:31:51.332 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.340+0000 7f3b627fc640 1 -- 172.21.15.46:0/4164053437 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5c02cd10 con 0x7f3b640ca390 2024-01-27T13:31:51.332 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.340+0000 7f3b627fc640 1 -- 172.21.15.46:0/4164053437 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c034610 con 0x7f3b640ca390 2024-01-27T13:31:51.333 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.340+0000 7f3b6a12d640 1 -- 172.21.15.46:0/4164053437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b640ca390 msgr2=0x7f3b64165340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.333 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.340+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/4164053437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b640ca390 0x7f3b64165340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009e50 tx=0x7f3b5c02c010 comp rx=0 tx=0).stop 2024-01-27T13:31:51.333 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.341+0000 7f3b6a12d640 1 -- 172.21.15.46:0/4164053437 shutdown_connections 2024-01-27T13:31:51.333 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.341+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/4164053437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b640ca390 0x7f3b64165340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.333 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.341+0000 7f3b6a12d640 1 -- 172.21.15.46:0/4164053437 >> 172.21.15.46:0/4164053437 conn(0x7f3b6406d2b0 msgr2=0x7f3b64071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:51.333 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.341+0000 7f3b6a12d640 1 -- 172.21.15.46:0/4164053437 shutdown_connections 2024-01-27T13:31:51.334 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.341+0000 7f3b6a12d640 1 -- 172.21.15.46:0/4164053437 wait complete. 2024-01-27T13:31:51.334 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.342+0000 7f3b6a12d640 1 Processor -- start 2024-01-27T13:31:51.334 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.342+0000 7f3b6a12d640 1 -- start start 2024-01-27T13:31:51.335 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b6a12d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 0x7f3b64159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:51.335 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b6a12d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b640cc590 0x7f3b641e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:51.335 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b6a12d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64153fd0 0x7f3b641e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:51.335 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b6a12d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641e5660 con 0x7f3b640cc590 2024-01-27T13:31:51.336 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b6a12d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641f03f0 con 0x7f3b64153fd0 2024-01-27T13:31:51.336 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b6a12d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641e4f60 con 0x7f3b640ca390 2024-01-27T13:31:51.336 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.343+0000 7f3b637fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 0x7f3b64159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:51.336 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.344+0000 7f3b637fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 0x7f3b64159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:45166/0 (socket says 172.21.15.46:45166) 2024-01-27T13:31:51.336 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.344+0000 7f3b637fe640 1 -- 172.21.15.46:0/3462781401 learned_addr learned my addr 172.21.15.46:0/3462781401 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:51.337 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.344+0000 7f3b63fff640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64153fd0 0x7f3b641e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:51.339 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.347+0000 7f3b637fe640 1 -- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64153fd0 msgr2=0x7f3b641e3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.339 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.347+0000 7f3b637fe640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64153fd0 0x7f3b641e3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.339 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.347+0000 7f3b637fe640 1 -- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b640cc590 msgr2=0x7f3b641e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.339 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.347+0000 7f3b637fe640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b640cc590 0x7f3b641e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.339 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.347+0000 7f3b637fe640 1 -- 172.21.15.46:0/3462781401 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c009b30 con 0x7f3b640ca390 2024-01-27T13:31:51.341 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.349+0000 7f3b637fe640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 0x7f3b64159640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400c400 tx=0x7f3b5400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:51.345 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.352+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540052d0 con 0x7f3b640ca390 2024-01-27T13:31:51.345 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.352+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b54005430 con 0x7f3b640ca390 2024-01-27T13:31:51.345 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.352+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54003830 con 0x7f3b640ca390 2024-01-27T13:31:51.345 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.352+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b64158cb0 con 0x7f3b640ca390 2024-01-27T13:31:51.345 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.353+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b641e5890 con 0x7f3b640ca390 2024-01-27T13:31:51.346 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.354+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b64074510 con 0x7f3b640ca390 2024-01-27T13:31:51.365 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.372+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 3) v1 ==== 89044+0+0 (secure 0 0 0) 0x7f3b54003990 con 0x7f3b640ca390 2024-01-27T13:31:51.365 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.373+0000 7f3b5bfff640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3b4406ad20 0x7f3b4406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:51.365 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.373+0000 7f3b62ffd640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3b4406ad20 0x7f3b4406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:51.366 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.373+0000 7f3b62ffd640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3b4406ad20 0x7f3b4406d1e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c000f60 tx=0x7f3b4c0079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:51.366 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.374+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3b54058270 con 0x7f3b640ca390 2024-01-27T13:31:51.599 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.606+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3b54053eb0 con 0x7f3b640ca390 2024-01-27T13:31:51.779 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.787+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b64159400 con 0x7f3b640ca390 2024-01-27T13:31:51.828 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.835+0000 7f3b5bfff640 1 -- 172.21.15.46:0/3462781401 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f3b54017020 con 0x7f3b640ca390 2024-01-27T13:31:51.828 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-27T13:31:51.828 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":10,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:31:49.577137+0000","last_up_change":"0.000000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3b4406ad20 msgr2=0x7f3b4406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3b4406ad20 0x7f3b4406d1e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c000f60 tx=0x7f3b4c0079d0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 msgr2=0x7f3b64159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 0x7f3b64159640 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400c400 tx=0x7f3b5400c8c0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 shutdown_connections 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3b4406ad20 0x7f3b4406d1e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b64153fd0 0x7f3b641e3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b640cc590 0x7f3b641e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 --2- 172.21.15.46:0/3462781401 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3b640ca390 0x7f3b64159640 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:51.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 >> 172.21.15.46:0/3462781401 conn(0x7f3b6406d2b0 msgr2=0x7f3b64073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:51.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 shutdown_connections 2024-01-27T13:31:51.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:51.837+0000 7f3b6a12d640 1 -- 172.21.15.46:0/3462781401 wait complete. 2024-01-27T13:31:51.840 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-27T13:31:54.052 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T13:31:54.060+0000 7f8c970d9640 -1 osd.0 0 log_to_monitors true 2024-01-27T13:31:54.053 INFO:tasks.ceph.osd.6.smithi078.stderr:2024-01-27T13:31:54.060+0000 7f9561a0c640 -1 osd.6 0 log_to_monitors true 2024-01-27T13:31:54.115 INFO:tasks.ceph.osd.7.smithi078.stderr:2024-01-27T13:31:54.123+0000 7fce56411640 -1 osd.7 0 log_to_monitors true 2024-01-27T13:31:54.127 INFO:tasks.ceph.osd.4.smithi078.stderr:2024-01-27T13:31:54.135+0000 7f4c3b00c640 -1 osd.4 0 log_to_monitors true 2024-01-27T13:31:54.129 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T13:31:54.137+0000 7ff641e0d640 -1 osd.1 0 log_to_monitors true 2024-01-27T13:31:54.172 INFO:tasks.ceph.osd.5.smithi078.stderr:2024-01-27T13:31:54.180+0000 7fd234c19640 -1 osd.5 0 log_to_monitors true 2024-01-27T13:31:54.185 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T13:31:54.193+0000 7f2fbd468640 -1 osd.3 0 log_to_monitors true 2024-01-27T13:31:54.207 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T13:31:54.215+0000 7fae974ce640 -1 osd.2 0 log_to_monitors true 2024-01-27T13:31:55.945 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T13:31:55.953+0000 7f8c93069640 -1 osd.0 0 waiting for initial osdmap 2024-01-27T13:31:56.004 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T13:31:56.012+0000 7f8c8ae90640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:56.282 INFO:tasks.ceph.osd.6.smithi078.stderr:2024-01-27T13:31:56.288+0000 7f955d3cd640 -1 osd.6 0 waiting for initial osdmap 2024-01-27T13:31:56.308 INFO:tasks.ceph.osd.4.smithi078.stderr:2024-01-27T13:31:56.315+0000 7f4c36a6f640 -1 osd.4 0 waiting for initial osdmap 2024-01-27T13:31:56.319 INFO:tasks.ceph.osd.6.smithi078.stderr:2024-01-27T13:31:56.326+0000 7f95551f4640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:56.333 INFO:tasks.ceph.osd.4.smithi078.stderr:2024-01-27T13:31:56.340+0000 7f4c2e896640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:56.368 INFO:tasks.ceph.osd.7.smithi078.stderr:2024-01-27T13:31:56.374+0000 7fce51dcd640 -1 osd.7 0 waiting for initial osdmap 2024-01-27T13:31:56.452 INFO:tasks.ceph.osd.7.smithi078.stderr:2024-01-27T13:31:56.459+0000 7fce49bf4640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:57.141 INFO:tasks.ceph.osd.5.smithi078.stderr:2024-01-27T13:31:57.148+0000 7fd230e8a640 -1 osd.5 0 waiting for initial osdmap 2024-01-27T13:31:57.159 INFO:tasks.ceph.osd.5.smithi078.stderr:2024-01-27T13:31:57.166+0000 7fd22849d640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:57.399 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T13:31:57.406+0000 7f2fb93f8640 -1 osd.3 0 waiting for initial osdmap 2024-01-27T13:31:57.435 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T13:31:57.441+0000 7fae9345e640 -1 osd.2 0 waiting for initial osdmap 2024-01-27T13:31:57.436 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T13:31:57.444+0000 7ff63d753640 -1 osd.1 0 waiting for initial osdmap 2024-01-27T13:31:57.461 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T13:31:57.469+0000 7fae8b285640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:57.493 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T13:31:57.501+0000 7f2fb121f640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:57.497 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T13:31:57.505+0000 7ff63557a640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-27T13:31:58.256 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:31:58.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:31:58.647 DEBUG:teuthology.orchestra.run.smithi046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-27T13:31:58.740 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.748+0000 7fdb3c33f640 1 Processor -- start 2024-01-27T13:31:58.740 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.748+0000 7fdb3c33f640 1 -- start start 2024-01-27T13:31:58.741 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.749+0000 7fdb3c33f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb340cb340 0x7fdb3406b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:58.741 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.749+0000 7fdb3c33f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb34159980 con 0x7fdb34153c00 2024-01-27T13:31:58.741 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.749+0000 7fdb3c33f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb340cc830 con 0x7fdb3406bab0 2024-01-27T13:31:58.741 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.749+0000 7fdb3c33f640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb340c4850 con 0x7fdb340cb340 2024-01-27T13:31:58.749 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.757+0000 7fdb398da640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb340cb340 0x7fdb3406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:58.750 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.758+0000 7fdb398da640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdb340cb340 0x7fdb3406b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55120/0 (socket says 172.21.15.46:55120) 2024-01-27T13:31:58.750 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.758+0000 7fdb398da640 1 -- 172.21.15.46:0/270639995 learned_addr learned my addr 172.21.15.46:0/270639995 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:58.757 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.765+0000 7fdb398da640 1 -- 172.21.15.46:0/270639995 >> v1:172.21.15.78:6789/0 conn(0x7fdb3406bab0 legacy=0x7fdb340ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:58.757 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.765+0000 7fdb398da640 1 -- 172.21.15.46:0/270639995 >> v1:172.21.15.46:6789/0 conn(0x7fdb34153c00 legacy=0x7fdb340cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:58.757 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.765+0000 7fdb398da640 1 -- 172.21.15.46:0/270639995 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34159c00 con 0x7fdb340cb340 2024-01-27T13:31:58.762 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.770+0000 7fdb398da640 1 --2- 172.21.15.46:0/270639995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb340cb340 0x7fdb3406b570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009870 tx=0x7fdb2402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5fb99045a1a789 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:58.769 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.777+0000 7fdb390d9640 1 -- 172.21.15.46:0/270639995 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2402f840 con 0x7fdb340cb340 2024-01-27T13:31:58.770 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.777+0000 7fdb390d9640 1 -- 172.21.15.46:0/270639995 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2402f9a0 con 0x7fdb340cb340 2024-01-27T13:31:58.770 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.777+0000 7fdb390d9640 1 -- 172.21.15.46:0/270639995 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2402fd30 con 0x7fdb340cb340 2024-01-27T13:31:58.770 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 -- 172.21.15.46:0/270639995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb340cb340 msgr2=0x7fdb3406b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/270639995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb340cb340 0x7fdb3406b570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009870 tx=0x7fdb2402ba20 comp rx=0 tx=0).stop 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 -- 172.21.15.46:0/270639995 shutdown_connections 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/270639995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb340cb340 0x7fdb3406b570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 -- 172.21.15.46:0/270639995 >> 172.21.15.46:0/270639995 conn(0x7fdb34072150 msgr2=0x7fdb34072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 -- 172.21.15.46:0/270639995 shutdown_connections 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.778+0000 7fdb3c33f640 1 -- 172.21.15.46:0/270639995 wait complete. 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.779+0000 7fdb3c33f640 1 Processor -- start 2024-01-27T13:31:58.771 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.779+0000 7fdb3c33f640 1 -- start start 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.780+0000 7fdb3c33f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb3406bab0 0x7fdb340b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.780+0000 7fdb3c33f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb340cb340 0x7fdb3414e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.780+0000 7fdb3c33f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 0x7fdb341eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.780+0000 7fdb3c33f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb34152c70 con 0x7fdb34153c00 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.780+0000 7fdb3c33f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb341efb10 con 0x7fdb340cb340 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.780+0000 7fdb3c33f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb341477e0 con 0x7fdb3406bab0 2024-01-27T13:31:58.773 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.781+0000 7fdb3a8dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 0x7fdb341eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:58.774 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.781+0000 7fdb3a0db640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb3406bab0 0x7fdb340b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:58.774 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.781+0000 7fdb3a8dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 0x7fdb341eff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55134/0 (socket says 172.21.15.46:55134) 2024-01-27T13:31:58.774 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.781+0000 7fdb3a8dc640 1 -- 172.21.15.46:0/3957405577 learned_addr learned my addr 172.21.15.46:0/3957405577 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:58.777 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.785+0000 7fdb3a8dc640 1 -- 172.21.15.46:0/3957405577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb3406bab0 msgr2=0x7fdb340b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:58.777 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.785+0000 7fdb3a8dc640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb3406bab0 0x7fdb340b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:58.777 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.785+0000 7fdb3a8dc640 1 -- 172.21.15.46:0/3957405577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb340cb340 msgr2=0x7fdb3414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:58.777 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.785+0000 7fdb3a8dc640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb340cb340 0x7fdb3414e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:58.777 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.785+0000 7fdb3a8dc640 1 -- 172.21.15.46:0/3957405577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240094d0 con 0x7fdb34153c00 2024-01-27T13:31:58.780 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.788+0000 7fdb3a8dc640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 0x7fdb341eff30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00b9c0 tx=0x7fdb2c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:58.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.838+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00cba0 con 0x7fdb34153c00 2024-01-27T13:31:58.830 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.838+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00cd00 con 0x7fdb34153c00 2024-01-27T13:31:58.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.838+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c014680 con 0x7fdb34153c00 2024-01-27T13:31:58.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.838+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb34152740 con 0x7fdb34153c00 2024-01-27T13:31:58.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.838+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb340b4be0 con 0x7fdb34153c00 2024-01-27T13:31:58.831 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:58.839+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb341efc50 con 0x7fdb34153c00 2024-01-27T13:31:59.098 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.105+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7fdb2c01d3b0 con 0x7fdb34153c00 2024-01-27T13:31:59.098 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.105+0000 7fdb2affd640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdb1806ae90 0x7fdb1806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.098 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.105+0000 7fdb3a0db640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdb1806ae90 0x7fdb1806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:59.098 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.106+0000 7fdb3a0db640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdb1806ae90 0x7fdb1806d350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdb30001780 tx=0x7fdb30009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:59.111 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.118+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4846+0+0 (secure 0 0 0) 0x7fdb2c0583d0 con 0x7fdb34153c00 2024-01-27T13:31:59.111 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.119+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdb2c054710 con 0x7fdb34153c00 2024-01-27T13:31:59.308 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.316+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb341efc50 con 0x7fdb34153c00 2024-01-27T13:31:59.422 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.430+0000 7fdb2affd640 1 -- 172.21.15.46:0/3957405577 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12750 (secure 0 0 0) 0x7fdb341efc50 con 0x7fdb34153c00 2024-01-27T13:31:59.423 INFO:teuthology.misc.health.smithi046.stdout: 2024-01-27T13:31:59.423 INFO:teuthology.misc.health.smithi046.stdout:{"epoch":15,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:31:58.380129+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:31:59.425 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdb1806ae90 msgr2=0x7fdb1806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:59.425 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdb1806ae90 0x7fdb1806d350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdb30001780 tx=0x7fdb30009040 comp rx=0 tx=0).stop 2024-01-27T13:31:59.425 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 msgr2=0x7fdb341eff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:59.425 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 0x7fdb341eff30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00b9c0 tx=0x7fdb2c00be80 comp rx=0 tx=0).stop 2024-01-27T13:31:59.425 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 shutdown_connections 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdb1806ae90 0x7fdb1806d350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34153c00 0x7fdb341eff30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb340cb340 0x7fdb3414e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 --2- 172.21.15.46:0/3957405577 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdb3406bab0 0x7fdb340b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 >> 172.21.15.46:0/3957405577 conn(0x7fdb34072150 msgr2=0x7fdb34149450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 shutdown_connections 2024-01-27T13:31:59.426 INFO:teuthology.misc.health.smithi046.stderr:2024-01-27T13:31:59.432+0000 7fdb3c33f640 1 -- 172.21.15.46:0/3957405577 wait complete. 2024-01-27T13:31:59.434 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-27T13:31:59.434 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-27T13:31:59.435 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T13:31:59.435 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-27T13:31:59.435 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-01-27T13:31:59.437 INFO:tasks.ceph.mds.a:Started 2024-01-27T13:31:59.437 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T13:31:59.437 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-27T13:31:59.438 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-01-27T13:31:59.439 INFO:tasks.ceph.mds.c:Started 2024-01-27T13:31:59.440 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T13:31:59.440 INFO:tasks.ceph.mds.e:Restarting daemon 2024-01-27T13:31:59.440 DEBUG:teuthology.orchestra.run.smithi046:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-01-27T13:31:59.442 INFO:tasks.ceph.mds.e:Started 2024-01-27T13:31:59.442 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T13:31:59.442 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-27T13:31:59.442 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-01-27T13:31:59.447 INFO:tasks.ceph.mds.b:Started 2024-01-27T13:31:59.447 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T13:31:59.447 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-27T13:31:59.447 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-01-27T13:31:59.449 INFO:tasks.ceph.mds.d:Started 2024-01-27T13:31:59.449 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-27T13:31:59.450 INFO:tasks.ceph.mds.f:Restarting daemon 2024-01-27T13:31:59.450 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-01-27T13:31:59.451 INFO:tasks.ceph.mds.f:Started 2024-01-27T13:31:59.452 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-27T13:31:59.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:31:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.585+0000 7f7708a90640 1 Processor -- start 2024-01-27T13:31:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.586+0000 7f7708a90640 1 -- start start 2024-01-27T13:31:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.586+0000 7f7708a90640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77040c2ca0 0x7f77041514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.586+0000 7f7708a90640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f77040c77d0 0x7f7704151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.586+0000 7f7708a90640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040ccf60 con 0x7f77040c28c0 2024-01-27T13:31:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.586+0000 7f7708a90640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040ca800 con 0x7f77040c77d0 2024-01-27T13:31:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.586+0000 7f7708a90640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77041576d0 con 0x7f77040c2ca0 2024-01-27T13:31:59.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.592+0000 7f7701d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77040c2ca0 0x7f77041514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:59.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.592+0000 7f770259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f77040c28c0 0x7f77040c1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:41014/0 (socket says 172.21.15.46:41014) 2024-01-27T13:31:59.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.592+0000 7f770259c640 1 -- 172.21.15.46:0/241652514 learned_addr learned my addr 172.21.15.46:0/241652514 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:31:59.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.597+0000 7f7701d9b640 1 -- 172.21.15.46:0/241652514 >> v2:172.21.15.46:3300/0 conn(0x7f77040c77d0 msgr2=0x7f7704151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:31:59.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.597+0000 7f7701d9b640 1 --2- 172.21.15.46:0/241652514 >> v2:172.21.15.46:3300/0 conn(0x7f77040c77d0 0x7f7704151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.597+0000 7f7701d9b640 1 -- 172.21.15.46:0/241652514 >> v1:172.21.15.78:6789/0 conn(0x7f77040c28c0 legacy=0x7f77040c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:59.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.597+0000 7f7701d9b640 1 -- 172.21.15.46:0/241652514 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040cd200 con 0x7f77040c2ca0 2024-01-27T13:31:59.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.601+0000 7f7701d9b640 1 --2- 172.21.15.46:0/241652514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f77041514f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76f80097a0 tx=0x7f76f802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17180aebfa8a458f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:59.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.605+0000 7f770159a640 1 -- 172.21.15.46:0/241652514 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8031830 con 0x7f77040c2ca0 2024-01-27T13:31:59.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.605+0000 7f770159a640 1 -- 172.21.15.46:0/241652514 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8031990 con 0x7f77040c2ca0 2024-01-27T13:31:59.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.605+0000 7f770159a640 1 -- 172.21.15.46:0/241652514 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8031d20 con 0x7f77040c2ca0 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 -- 172.21.15.46:0/241652514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 msgr2=0x7f77041514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 --2- 172.21.15.46:0/241652514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f77041514f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f76f80097a0 tx=0x7f76f802b8d0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 -- 172.21.15.46:0/241652514 shutdown_connections 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 --2- 172.21.15.46:0/241652514 >> v2:172.21.15.46:3300/0 conn(0x7f77040c77d0 0x7f7704151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 --2- 172.21.15.46:0/241652514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f77041514f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 -- 172.21.15.46:0/241652514 >> 172.21.15.46:0/241652514 conn(0x7f770406efe0 msgr2=0x7f770406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:31:59.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 -- 172.21.15.46:0/241652514 shutdown_connections 2024-01-27T13:31:59.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.606+0000 7f7708a90640 1 -- 172.21.15.46:0/241652514 wait complete. 2024-01-27T13:31:59.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.608+0000 7f7708a90640 1 Processor -- start 2024-01-27T13:31:59.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.608+0000 7f7708a90640 1 -- start start 2024-01-27T13:31:59.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7708a90640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77040c28c0 0x7f7704148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7708a90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f7704155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7708a90640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77040c77d0 0x7f7704156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7708a90640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7704155c90 con 0x7f77040c77d0 2024-01-27T13:31:59.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7708a90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77041edfd0 con 0x7f77040c2ca0 2024-01-27T13:31:59.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7708a90640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77041ee500 con 0x7f77040c28c0 2024-01-27T13:31:59.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.610+0000 7f7701d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f7704155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:59.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.611+0000 7f7701d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f7704155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:45726/0 (socket says 172.21.15.46:45726) 2024-01-27T13:31:59.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.611+0000 7f7701d9b640 1 -- 172.21.15.46:0/1884074583 learned_addr learned my addr 172.21.15.46:0/1884074583 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:31:59.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.614+0000 7f7701d9b640 1 -- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77040c28c0 msgr2=0x7f7704148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:59.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.614+0000 7f7701d9b640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77040c28c0 0x7f7704148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.614+0000 7f7701d9b640 1 -- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77040c77d0 msgr2=0x7f7704156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:31:59.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.614+0000 7f7701d9b640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77040c77d0 0x7f7704156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:31:59.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.614+0000 7f7701d9b640 1 -- 172.21.15.46:0/1884074583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8009400 con 0x7f77040c2ca0 2024-01-27T13:31:59.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.617+0000 7f7701d9b640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f7704155750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76f80098c0 tx=0x7f76f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.622+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f803bb70 con 0x7f77040c2ca0 2024-01-27T13:31:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.622+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f803bcf0 con 0x7f77040c2ca0 2024-01-27T13:31:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.622+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770414a040 con 0x7f77040c2ca0 2024-01-27T13:31:59.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.622+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8045630 con 0x7f77040c2ca0 2024-01-27T13:31:59.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.622+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7704149a80 con 0x7f77040c2ca0 2024-01-27T13:31:59.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.623+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704155470 con 0x7f77040c2ca0 2024-01-27T13:31:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.913+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f76f804e450 con 0x7f77040c2ca0 2024-01-27T13:31:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.913+0000 7f76f2ffd640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f76e406ae90 0x7f76e406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:31:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.914+0000 7f770259c640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f76e406ae90 0x7f76e406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:31:59.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.914+0000 7f770259c640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f76e406ae90 0x7f76e406d350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000f60 tx=0x7f76f4007a80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:31:59.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.918+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76f802f2e0 con 0x7f77040c2ca0 2024-01-27T13:31:59.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:31:59.937+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f76f8076bc0 con 0x7f77040c2ca0 2024-01-27T13:32:00.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.160+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7704155470 con 0x7f77040c2ca0 2024-01-27T13:32:00.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.381+0000 7f76f2ffd640 1 -- 172.21.15.46:0/1884074583 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12828 (secure 0 0 0) 0x7f7704155470 con 0x7f77040c2ca0 2024-01-27T13:32:00.374 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:00.374 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":16,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:31:59.481981+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f76e406ae90 msgr2=0x7f76e406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f76e406ae90 0x7f76e406d350 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000f60 tx=0x7f76f4007a80 comp rx=0 tx=0).stop 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 msgr2=0x7f7704155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f7704155750 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76f80098c0 tx=0x7f76f80046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 shutdown_connections 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f76e406ae90 0x7f76e406d350 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77040c77d0 0x7f7704156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77040c2ca0 0x7f7704155750 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 --2- 172.21.15.46:0/1884074583 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f77040c28c0 0x7f7704148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 >> 172.21.15.46:0/1884074583 conn(0x7f770406efe0 msgr2=0x7f7704150750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 shutdown_connections 2024-01-27T13:32:00.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.384+0000 7f7708a90640 1 -- 172.21.15.46:0/1884074583 wait complete. 2024-01-27T13:32:00.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-27T13:32:00.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:32:00.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.507+0000 7fc523c1e640 1 Processor -- start 2024-01-27T13:32:00.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.507+0000 7fc523c1e640 1 -- start start 2024-01-27T13:32:00.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc523c1e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc51c0c6910 0x7fc51c0c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc523c1e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc51c070620 0x7fc51c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc523c1e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51c070190 con 0x7fc51c0c23f0 2024-01-27T13:32:00.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc523c1e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51c0c3180 con 0x7fc51c0c6910 2024-01-27T13:32:00.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc523c1e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0c7230 con 0x7fc51c070620 2024-01-27T13:32:00.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc5221bb640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc51c0c23f0 0x7fc51c06dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40730/0 (socket says 172.21.15.46:40730) 2024-01-27T13:32:00.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.508+0000 7fc5221bb640 1 -- 172.21.15.46:0/718153822 learned_addr learned my addr 172.21.15.46:0/718153822 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.512+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276990053 0 0) 0x7fc51c070190 con 0x7fc51c0c23f0 2024-01-27T13:32:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.512+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc508003520 con 0x7fc51c0c23f0 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301938263 0 0) 0x7fc508003520 con 0x7fc51c0c23f0 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc51c070620 msgr2=0x7fc51c15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc51c070620 0x7fc51c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 >> v2:172.21.15.78:3300/0 conn(0x7fc51c0c6910 msgr2=0x7fc51c0c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 --2- 172.21.15.46:0/718153822 >> v2:172.21.15.78:3300/0 conn(0x7fc51c0c6910 0x7fc51c0c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c15d240 con 0x7fc51c0c23f0 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2887288732 0 0) 0x7fc5140019f0 con 0x7fc51c0c23f0 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 >> v1:172.21.15.46:6789/0 conn(0x7fc51c0c23f0 legacy=0x7fc51c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:00.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc508003970 0x7fc508003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5080047c0 0x7fc508004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc51c070620 0x7fc50800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0c3180 con 0x7fc5080047c0 2024-01-27T13:32:00.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c0c7230 con 0x7fc508003970 2024-01-27T13:32:00.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.520+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080055d0 con 0x7fc51c070620 2024-01-27T13:32:00.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.523+0000 7fc5219ba640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc508003970 0x7fc508003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.525+0000 7fc5211b9640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5080047c0 0x7fc508004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.534+0000 7fc5219ba640 1 -- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc51c070620 msgr2=0x7fc50800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.534+0000 7fc5219ba640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc51c070620 0x7fc50800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.534+0000 7fc5219ba640 1 -- 172.21.15.46:0/718153822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5080047c0 msgr2=0x7fc508004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.534+0000 7fc5219ba640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5080047c0 0x7fc508004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.535+0000 7fc5219ba640 1 -- 172.21.15.46:0/718153822 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508003520 con 0x7fc508003970 2024-01-27T13:32:00.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.537+0000 7fc5219ba640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc508003970 0x7fc508003d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc518009860 tx=0x7fc5080057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395117b510933769 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:00.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.542+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518032600 con 0x7fc508003970 2024-01-27T13:32:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.542+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51802e050 con 0x7fc508003970 2024-01-27T13:32:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.542+0000 7fc5209b8640 1 -- 172.21.15.46:0/718153822 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5180329c0 con 0x7fc508003970 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc523c1e640 1 -- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc508003970 msgr2=0x7fc508003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc523c1e640 1 --2- 172.21.15.46:0/718153822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc508003970 0x7fc508003d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc518009860 tx=0x7fc5080057f0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc5221bb640 1 -- 172.21.15.46:0/718153822 reap_dead start 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc523c1e640 1 -- 172.21.15.46:0/718153822 shutdown_connections 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc523c1e640 1 -- 172.21.15.46:0/718153822 >> 172.21.15.46:0/718153822 conn(0x7fc51c0c8a10 msgr2=0x7fc51c0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc523c1e640 1 -- 172.21.15.46:0/718153822 shutdown_connections 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.543+0000 7fc523c1e640 1 -- 172.21.15.46:0/718153822 wait complete. 2024-01-27T13:32:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.545+0000 7fc523c1e640 1 Processor -- start 2024-01-27T13:32:00.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.545+0000 7fc523c1e640 1 -- start start 2024-01-27T13:32:00.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.546+0000 7fc523c1e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 0x7fc51c14a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.546+0000 7fc523c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51c0c3e90 0x7fc51c15c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.547+0000 7fc523c1e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc51c15cad0 0x7fc51c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.547+0000 7fc523c1e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c15be20 con 0x7fc51c0c3e90 2024-01-27T13:32:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.547+0000 7fc523c1e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c15cf80 con 0x7fc51c15cad0 2024-01-27T13:32:00.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.547+0000 7fc523c1e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c14a970 con 0x7fc508003970 2024-01-27T13:32:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.549+0000 7fc5221bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc51c15cad0 0x7fc51c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.549+0000 7fc5219ba640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 0x7fc51c14a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:00.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.550+0000 7fc5219ba640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 0x7fc51c14a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:40778/0 (socket says 172.21.15.46:40778) 2024-01-27T13:32:00.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.550+0000 7fc5219ba640 1 -- 172.21.15.46:0/1174016218 learned_addr learned my addr 172.21.15.46:0/1174016218 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.553+0000 7fc5219ba640 1 -- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc51c15cad0 msgr2=0x7fc51c15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.553+0000 7fc5219ba640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc51c15cad0 0x7fc51c15ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.553+0000 7fc5219ba640 1 -- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51c0c3e90 msgr2=0x7fc51c15c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.553+0000 7fc5219ba640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51c0c3e90 0x7fc51c15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:00.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.553+0000 7fc5219ba640 1 -- 172.21.15.46:0/1174016218 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0c5b50 con 0x7fc508003970 2024-01-27T13:32:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.556+0000 7fc5219ba640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 0x7fc51c14a430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc518035040 tx=0x7fc5180047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.561+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518032bb0 con 0x7fc508003970 2024-01-27T13:32:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.561+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518032d10 con 0x7fc508003970 2024-01-27T13:32:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.561+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc518003810 con 0x7fc508003970 2024-01-27T13:32:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.561+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c0c5e30 con 0x7fc508003970 2024-01-27T13:32:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.562+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c15c070 con 0x7fc508003970 2024-01-27T13:32:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.563+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51c0c6350 con 0x7fc508003970 2024-01-27T13:32:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.583+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7fc518003970 con 0x7fc508003970 2024-01-27T13:32:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.584+0000 7fc5127fc640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc50006ae40 0x7fc50006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:00.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.584+0000 7fc5211b9640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc50006ae40 0x7fc50006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:00.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.585+0000 7fc5211b9640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc50006ae40 0x7fc50006d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0c3450 tx=0x7fc50c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:00.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.586+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc51807a010 con 0x7fc508003970 2024-01-27T13:32:00.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:00.830+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc518076350 con 0x7fc508003970 2024-01-27T13:32:01.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.024+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc51c074410 con 0x7fc508003970 2024-01-27T13:32:01.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.091+0000 7fc5127fc640 1 -- 172.21.15.46:0/1174016218 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc518037020 con 0x7fc508003970 2024-01-27T13:32:01.084 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:32:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc50006ae40 msgr2=0x7fc50006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc50006ae40 0x7fc50006d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0c3450 tx=0x7fc50c008040 comp rx=0 tx=0).stop 2024-01-27T13:32:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 msgr2=0x7fc51c14a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 0x7fc51c14a430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc518035040 tx=0x7fc5180047d0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 shutdown_connections 2024-01-27T13:32:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc50006ae40 0x7fc50006d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc51c15cad0 0x7fc51c15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51c0c3e90 0x7fc51c15c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 --2- 172.21.15.46:0/1174016218 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc508003970 0x7fc51c14a430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 >> 172.21.15.46:0/1174016218 conn(0x7fc51c0c8a10 msgr2=0x7fc51c06dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 shutdown_connections 2024-01-27T13:32:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.094+0000 7fc523c1e640 1 -- 172.21.15.46:0/1174016218 wait complete. 2024-01-27T13:32:01.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:32:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.244+0000 7fa08baa6640 1 Processor -- start 2024-01-27T13:32:01.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 -- start start 2024-01-27T13:32:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0840c28c0 0x7fa0840c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa0840c2ca0 0x7fa0841514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c77d0 0x7fa084151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0840ccf60 con 0x7fa0840c2ca0 2024-01-27T13:32:01.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0840ca800 con 0x7fa0840c28c0 2024-01-27T13:32:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.245+0000 7fa08baa6640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0841576d0 con 0x7fa0840c77d0 2024-01-27T13:32:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.246+0000 7fa089041640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa0840c2ca0 0x7fa0841514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.247+0000 7fa089041640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa0840c2ca0 0x7fa0841514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55194/0 (socket says 172.21.15.46:55194) 2024-01-27T13:32:01.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.247+0000 7fa089041640 1 -- 172.21.15.46:0/2770633418 learned_addr learned my addr 172.21.15.46:0/2770633418 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:01.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.250+0000 7fa089041640 1 -- 172.21.15.46:0/2770633418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c77d0 msgr2=0x7fa084151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:01.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.250+0000 7fa089041640 1 --2- 172.21.15.46:0/2770633418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c77d0 0x7fa084151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.250+0000 7fa089041640 1 -- 172.21.15.46:0/2770633418 >> v2:172.21.15.78:3300/0 conn(0x7fa0840c28c0 msgr2=0x7fa0840c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:01.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.250+0000 7fa089041640 1 --2- 172.21.15.46:0/2770633418 >> v2:172.21.15.78:3300/0 conn(0x7fa0840c28c0 0x7fa0840c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.250+0000 7fa089041640 1 -- 172.21.15.46:0/2770633418 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0840cd200 con 0x7fa0840c2ca0 2024-01-27T13:32:01.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.253+0000 7fa089041640 1 --2- 172.21.15.46:0/2770633418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c2ca0 0x7fa0841514f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa0840718d0 tx=0x7fa07402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14151b5a9b54891 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:01.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.258+0000 7fa088840640 1 -- 172.21.15.46:0/2770633418 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074031870 con 0x7fa0840c2ca0 2024-01-27T13:32:01.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.258+0000 7fa088840640 1 -- 172.21.15.46:0/2770633418 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0740319d0 con 0x7fa0840c2ca0 2024-01-27T13:32:01.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.258+0000 7fa088840640 1 -- 172.21.15.46:0/2770633418 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074031d60 con 0x7fa0840c2ca0 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 -- 172.21.15.46:0/2770633418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c2ca0 msgr2=0x7fa0841514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 --2- 172.21.15.46:0/2770633418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c2ca0 0x7fa0841514f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa0840718d0 tx=0x7fa07402b910 comp rx=0 tx=0).stop 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 -- 172.21.15.46:0/2770633418 shutdown_connections 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 --2- 172.21.15.46:0/2770633418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c2ca0 0x7fa0841514f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 --2- 172.21.15.46:0/2770633418 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c77d0 0x7fa084151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 --2- 172.21.15.46:0/2770633418 >> v2:172.21.15.78:3300/0 conn(0x7fa0840c28c0 0x7fa0840c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 -- 172.21.15.46:0/2770633418 >> 172.21.15.46:0/2770633418 conn(0x7fa08406efe0 msgr2=0x7fa08406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 -- 172.21.15.46:0/2770633418 shutdown_connections 2024-01-27T13:32:01.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.259+0000 7fa08baa6640 1 -- 172.21.15.46:0/2770633418 wait complete. 2024-01-27T13:32:01.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.261+0000 7fa08baa6640 1 Processor -- start 2024-01-27T13:32:01.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.261+0000 7fa08baa6640 1 -- start start 2024-01-27T13:32:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.262+0000 7fa08baa6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c28c0 0x7fa0841f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.262+0000 7fa08baa6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840c2ca0 0x7fa08406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.262+0000 7fa08baa6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 0x7fa08406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.262+0000 7fa08baa6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084148c80 con 0x7fa0840c77d0 2024-01-27T13:32:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.262+0000 7fa08baa6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0841ef4a0 con 0x7fa0840c2ca0 2024-01-27T13:32:01.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.262+0000 7fa08baa6640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0841f3770 con 0x7fa0840c28c0 2024-01-27T13:32:01.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.264+0000 7fa089041640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840c2ca0 0x7fa08406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:01.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.264+0000 7fa08a043640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 0x7fa08406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:01.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.264+0000 7fa08a043640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 0x7fa08406d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55198/0 (socket says 172.21.15.46:55198) 2024-01-27T13:32:01.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.264+0000 7fa08a043640 1 -- 172.21.15.46:0/4254176993 learned_addr learned my addr 172.21.15.46:0/4254176993 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.270+0000 7fa08a043640 1 -- 172.21.15.46:0/4254176993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c28c0 msgr2=0x7fa0841f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:01.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.270+0000 7fa08a043640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c28c0 0x7fa0841f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.270+0000 7fa08a043640 1 -- 172.21.15.46:0/4254176993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840c2ca0 msgr2=0x7fa08406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.270+0000 7fa08a043640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840c2ca0 0x7fa08406cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:01.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.270+0000 7fa08a043640 1 -- 172.21.15.46:0/4254176993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740094d0 con 0x7fa0840c77d0 2024-01-27T13:32:01.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.276+0000 7fa08a043640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 0x7fa08406d1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ba10 tx=0x7fa07c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:01.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.279+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c00cb40 con 0x7fa0840c77d0 2024-01-27T13:32:01.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.279+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0840b1ab0 con 0x7fa0840c77d0 2024-01-27T13:32:01.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.279+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa084148ed0 con 0x7fa0840c77d0 2024-01-27T13:32:01.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.280+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0840cd790 con 0x7fa0840c77d0 2024-01-27T13:32:01.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.282+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c00cca0 con 0x7fa0840c77d0 2024-01-27T13:32:01.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.282+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c01e640 con 0x7fa0840c77d0 2024-01-27T13:32:01.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.583+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7fa07c014440 con 0x7fa0840c77d0 2024-01-27T13:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.583+0000 7fa07a7fc640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa06806ae40 0x7fa06806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.583+0000 7fa089842640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa06806ae40 0x7fa06806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:01.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.584+0000 7fa089842640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa06806ae40 0x7fa06806d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa080009670 tx=0x7fa080006bf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.610+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa07c058980 con 0x7fa0840c77d0 2024-01-27T13:32:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.610+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa07c054cc0 con 0x7fa0840c77d0 2024-01-27T13:32:01.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:01.885+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa084156230 con 0x7fa0840c77d0 2024-01-27T13:32:02.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.165+0000 7fa07a7fc640 1 -- 172.21.15.46:0/4254176993 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fa07c023090 con 0x7fa0840c77d0 2024-01-27T13:32:02.158 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:02.158 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-27T13:32:02.158 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-27T13:32:02.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa06806ae40 msgr2=0x7fa06806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa06806ae40 0x7fa06806d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa080009670 tx=0x7fa080006bf0 comp rx=0 tx=0).stop 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 msgr2=0x7fa08406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 0x7fa08406d1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00ba10 tx=0x7fa07c00bed0 comp rx=0 tx=0).stop 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 shutdown_connections 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa06806ae40 0x7fa06806d300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0840c77d0 0x7fa08406d1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0840c2ca0 0x7fa08406cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 --2- 172.21.15.46:0/4254176993 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa0840c28c0 0x7fa0841f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 >> 172.21.15.46:0/4254176993 conn(0x7fa08406efe0 msgr2=0x7fa0840c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 shutdown_connections 2024-01-27T13:32:02.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:02.167+0000 7fa08baa6640 1 -- 172.21.15.46:0/4254176993 wait complete. 2024-01-27T13:32:04.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:32:04.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.287+0000 7f0dbc39e640 1 Processor -- start 2024-01-27T13:32:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.287+0000 7f0dbc39e640 1 -- start start 2024-01-27T13:32:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.288+0000 7f0dbc39e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0db40c7470 0x7f0db4159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:04.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.288+0000 7f0dbc39e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db415a8c0 con 0x7f0db40c7920 2024-01-27T13:32:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.288+0000 7f0dbc39e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db415a5e0 con 0x7f0db40c7090 2024-01-27T13:32:04.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.288+0000 7f0dbc39e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40700b0 con 0x7f0db40c7470 2024-01-27T13:32:04.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.318+0000 7f0dba13a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0db40c7090 0x7f0db406f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:41022/0 (socket says 172.21.15.46:41022) 2024-01-27T13:32:04.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.318+0000 7f0dba13a640 1 -- 172.21.15.46:0/2939591640 learned_addr learned my addr 172.21.15.46:0/2939591640 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:04.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.336+0000 7f0db9939640 1 --2- 172.21.15.46:0/2939591640 >> v2:172.21.15.46:3300/0 conn(0x7f0db40c7470 0x7f0db4159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:04.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.339+0000 7f0db9138640 1 -- 172.21.15.46:0/2939591640 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383690300 0 0) 0x7f0db415a5e0 con 0x7f0db40c7090 2024-01-27T13:32:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.339+0000 7f0db9138640 1 -- 172.21.15.46:0/2939591640 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da0003520 con 0x7f0db40c7090 2024-01-27T13:32:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.339+0000 7f0db9939640 1 -- 172.21.15.46:0/2939591640 >> v1:172.21.15.78:6789/0 conn(0x7f0db40c7090 legacy=0x7f0db406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.339+0000 7f0db9939640 1 -- 172.21.15.46:0/2939591640 >> v1:172.21.15.46:6789/0 conn(0x7f0db40c7920 legacy=0x7f0db41501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.339+0000 7f0db9939640 1 -- 172.21.15.46:0/2939591640 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40c0fd0 con 0x7f0db40c7470 2024-01-27T13:32:04.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.353+0000 7f0db9939640 1 --2- 172.21.15.46:0/2939591640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db4159a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0da40097a0 tx=0x7f0da402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adc5705a43aadf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.414+0000 7f0db9138640 1 -- 172.21.15.46:0/2939591640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da402f810 con 0x7f0db40c7470 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.414+0000 7f0db9138640 1 -- 172.21.15.46:0/2939591640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da402f970 con 0x7f0db40c7470 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.414+0000 7f0db9138640 1 -- 172.21.15.46:0/2939591640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da402fd00 con 0x7f0db40c7470 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 -- 172.21.15.46:0/2939591640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 msgr2=0x7f0db4159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/2939591640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db4159a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0da40097a0 tx=0x7f0da402b9f0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 -- 172.21.15.46:0/2939591640 shutdown_connections 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/2939591640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db4159a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 -- 172.21.15.46:0/2939591640 >> 172.21.15.46:0/2939591640 conn(0x7f0db40c8a10 msgr2=0x7f0db40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:04.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 -- 172.21.15.46:0/2939591640 shutdown_connections 2024-01-27T13:32:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.415+0000 7f0dbc39e640 1 -- 172.21.15.46:0/2939591640 wait complete. 2024-01-27T13:32:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.417+0000 7f0dbc39e640 1 Processor -- start 2024-01-27T13:32:04.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.417+0000 7f0dbc39e640 1 -- start start 2024-01-27T13:32:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.418+0000 7f0dbc39e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db40c7090 0x7f0db41e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.418+0000 7f0dbc39e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db40cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.418+0000 7f0dbc39e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db40c7920 0x7f0db4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.418+0000 7f0dbc39e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41f0190 con 0x7f0db40c7470 2024-01-27T13:32:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.418+0000 7f0dbc39e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db414a880 con 0x7f0db40c7920 2024-01-27T13:32:04.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.418+0000 7f0dbc39e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41ef250 con 0x7f0db40c7090 2024-01-27T13:32:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.419+0000 7f0db9939640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db40cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.419+0000 7f0db9939640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db40cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55230/0 (socket says 172.21.15.46:55230) 2024-01-27T13:32:04.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.419+0000 7f0db9939640 1 -- 172.21.15.46:0/518842436 learned_addr learned my addr 172.21.15.46:0/518842436 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.423+0000 7f0db9939640 1 -- 172.21.15.46:0/518842436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db40c7090 msgr2=0x7f0db41e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.423+0000 7f0db9939640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db40c7090 0x7f0db41e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.423+0000 7f0db9939640 1 -- 172.21.15.46:0/518842436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db40c7920 msgr2=0x7f0db4157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.423+0000 7f0db9939640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db40c7920 0x7f0db4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.423+0000 7f0db9939640 1 -- 172.21.15.46:0/518842436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009400 con 0x7f0db40c7470 2024-01-27T13:32:04.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.426+0000 7f0db9939640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db40cb220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0da40098c0 tx=0x7f0da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:04.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.430+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4046070 con 0x7f0db40c7470 2024-01-27T13:32:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.430+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40376d0 con 0x7f0db40c7470 2024-01-27T13:32:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.430+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da403b040 con 0x7f0db40c7470 2024-01-27T13:32:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.430+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db41ef510 con 0x7f0db40c7470 2024-01-27T13:32:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.430+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db41efad0 con 0x7f0db40c7470 2024-01-27T13:32:04.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.432+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db4074410 con 0x7f0db40c7470 2024-01-27T13:32:04.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.706+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0da4037a80 con 0x7f0db40c7470 2024-01-27T13:32:04.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.706+0000 7f0daaffd640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d9806af00 0x7f0d9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:04.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.707+0000 7f0dba13a640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d9806af00 0x7f0d9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:04.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.707+0000 7f0dba13a640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d9806af00 0x7f0d9806d3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0db0001610 tx=0x7f0db0007930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.730+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0da404a370 con 0x7f0db40c7470 2024-01-27T13:32:04.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.730+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0da4077680 con 0x7f0db40c7470 2024-01-27T13:32:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.955+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db4157620 con 0x7f0db40c7470 2024-01-27T13:32:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.963+0000 7f0daaffd640 1 -- 172.21.15.46:0/518842436 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f0da407aca0 con 0x7f0db40c7470 2024-01-27T13:32:04.956 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:04.956 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-27T13:32:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-01-27T13:32:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d9806af00 msgr2=0x7f0d9806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d9806af00 0x7f0d9806d3c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0db0001610 tx=0x7f0db0007930 comp rx=0 tx=0).stop 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 msgr2=0x7f0db40cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db40cb220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0da40098c0 tx=0x7f0da40046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 shutdown_connections 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d9806af00 0x7f0d9806d3c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0db40c7920 0x7f0db4157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0db40c7470 0x7f0db40cb220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 --2- 172.21.15.46:0/518842436 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0db40c7090 0x7f0db41e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 >> 172.21.15.46:0/518842436 conn(0x7f0db40c8a10 msgr2=0x7f0db4159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 shutdown_connections 2024-01-27T13:32:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:04.966+0000 7f0dbc39e640 1 -- 172.21.15.46:0/518842436 wait complete. 2024-01-27T13:32:05.875 INFO:tasks.ceph.mds.b.smithi078.stdout:starting mds.b at 2024-01-27T13:32:06.043 INFO:tasks.ceph.mds.f.smithi078.stdout:starting mds.f at 2024-01-27T13:32:06.051 INFO:tasks.ceph.mds.d.smithi078.stdout:starting mds.d at 2024-01-27T13:32:06.059 INFO:tasks.ceph.mds.a.smithi046.stdout:starting mds.a at 2024-01-27T13:32:06.132 INFO:tasks.ceph.mds.e.smithi046.stdout:starting mds.e at 2024-01-27T13:32:06.143 INFO:tasks.ceph.mds.c.smithi046.stdout:starting mds.c at 2024-01-27T13:32:06.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:32:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.079+0000 7f6b7dac9640 1 Processor -- start 2024-01-27T13:32:07.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.079+0000 7f6b7dac9640 1 -- start start 2024-01-27T13:32:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.079+0000 7f6b7dac9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6b780c8f00 0x7f6b780cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.079+0000 7f6b7dac9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b780c92e0 0x7f6b780cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b7dac9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780ca9f0 con 0x7f6b7815cf00 2024-01-27T13:32:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b7dac9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780cc9c0 con 0x7f6b780c92e0 2024-01-27T13:32:07.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b7dac9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b78159d50 con 0x7f6b780c8f00 2024-01-27T13:32:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b76ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6b780c92e0 0x7f6b780cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b77fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6b7815cf00 0x7f6b7815d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33206/0 (socket says 172.21.15.46:33206) 2024-01-27T13:32:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b77fff640 1 -- 172.21.15.46:0/2985247843 learned_addr learned my addr 172.21.15.46:0/2985247843 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:07.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.080+0000 7f6b777fe640 1 --2- 172.21.15.46:0/2985247843 >> v2:172.21.15.78:3300/0 conn(0x7f6b780c8f00 0x7f6b780cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.083+0000 7f6b777fe640 1 -- 172.21.15.46:0/2985247843 >> v2:172.21.15.46:3300/0 conn(0x7f6b780c92e0 msgr2=0x7f6b780cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.083+0000 7f6b777fe640 1 --2- 172.21.15.46:0/2985247843 >> v2:172.21.15.46:3300/0 conn(0x7f6b780c92e0 0x7f6b780cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.083+0000 7f6b777fe640 1 -- 172.21.15.46:0/2985247843 >> v1:172.21.15.46:6789/0 conn(0x7f6b7815cf00 legacy=0x7f6b7815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:07.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.083+0000 7f6b777fe640 1 -- 172.21.15.46:0/2985247843 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780cc6e0 con 0x7f6b780c8f00 2024-01-27T13:32:07.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.085+0000 7f6b777fe640 1 --2- 172.21.15.46:0/2985247843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b780cf010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6b780d01c0 tx=0x7f6b6802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=424b3ff2ab7ade32 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:07.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.088+0000 7f6b767fc640 1 -- 172.21.15.46:0/2985247843 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68031830 con 0x7f6b780c8f00 2024-01-27T13:32:07.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.088+0000 7f6b767fc640 1 -- 172.21.15.46:0/2985247843 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68031990 con 0x7f6b780c8f00 2024-01-27T13:32:07.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.088+0000 7f6b767fc640 1 -- 172.21.15.46:0/2985247843 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68031d20 con 0x7f6b780c8f00 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 -- 172.21.15.46:0/2985247843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 msgr2=0x7f6b780cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/2985247843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b780cf010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6b780d01c0 tx=0x7f6b6802b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 -- 172.21.15.46:0/2985247843 shutdown_connections 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/2985247843 >> v2:172.21.15.46:3300/0 conn(0x7f6b780c92e0 0x7f6b780cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/2985247843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b780cf010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 -- 172.21.15.46:0/2985247843 >> 172.21.15.46:0/2985247843 conn(0x7f6b7808afd0 msgr2=0x7f6b7808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 -- 172.21.15.46:0/2985247843 shutdown_connections 2024-01-27T13:32:07.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.089+0000 7f6b7dac9640 1 -- 172.21.15.46:0/2985247843 wait complete. 2024-01-27T13:32:07.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.090+0000 7f6b7dac9640 1 Processor -- start 2024-01-27T13:32:07.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.090+0000 7f6b7dac9640 1 -- start start 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.091+0000 7f6b7dac9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b7814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.091+0000 7f6b7dac9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 0x7f6b781ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.091+0000 7f6b7dac9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6b7815cf00 0x7f6b78157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.091+0000 7f6b7dac9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7814ed30 con 0x7f6b780c92e0 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.091+0000 7f6b7dac9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c4fb0 con 0x7f6b780c8f00 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.091+0000 7f6b7dac9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b78158f30 con 0x7f6b7815cf00 2024-01-27T13:32:07.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.092+0000 7f6b76ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 0x7f6b781ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.092+0000 7f6b76ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 0x7f6b781ef370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36984/0 (socket says 172.21.15.46:36984) 2024-01-27T13:32:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.092+0000 7f6b76ffd640 1 -- 172.21.15.46:0/423484617 learned_addr learned my addr 172.21.15.46:0/423484617 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.092+0000 7f6b777fe640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b7814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.092+0000 7f6b77fff640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6b7815cf00 0x7f6b78157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.095+0000 7f6b76ffd640 1 -- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6b7815cf00 msgr2=0x7f6b78157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.095+0000 7f6b76ffd640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6b7815cf00 0x7f6b78157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.095+0000 7f6b76ffd640 1 -- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 msgr2=0x7f6b7814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.095+0000 7f6b76ffd640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b7814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.095+0000 7f6b76ffd640 1 -- 172.21.15.46:0/423484617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009400 con 0x7f6b780c92e0 2024-01-27T13:32:07.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.097+0000 7f6b76ffd640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 0x7f6b781ef370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e980 tx=0x7f6b6c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.101+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c009670 con 0x7f6b780c92e0 2024-01-27T13:32:07.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.101+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c00ca00 con 0x7f6b780c92e0 2024-01-27T13:32:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.101+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00cd90 con 0x7f6b780c92e0 2024-01-27T13:32:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.101+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b78158190 con 0x7f6b780c92e0 2024-01-27T13:32:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.101+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78158450 con 0x7f6b780c92e0 2024-01-27T13:32:07.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.102+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7804eaf0 con 0x7f6b780c92e0 2024-01-27T13:32:07.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.123+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6b6c013470 con 0x7f6b780c92e0 2024-01-27T13:32:07.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.124+0000 7f6b5ffff640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6b6406aed0 0x7f6b6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.124+0000 7f6b777fe640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6b6406aed0 0x7f6b6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.124+0000 7f6b777fe640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6b6406aed0 0x7f6b6406d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b68036000 tx=0x7f6b6803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:07.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.126+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b6c058c30 con 0x7f6b780c92e0 2024-01-27T13:32:07.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.375+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6b6c054f70 con 0x7f6b780c92e0 2024-01-27T13:32:07.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.626+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b780cf7e0 con 0x7f6b780c92e0 2024-01-27T13:32:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.727+0000 7f6b5ffff640 1 -- 172.21.15.46:0/423484617 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5271 (secure 0 0 0) 0x7f6b6c021090 con 0x7f6b780c92e0 2024-01-27T13:32:07.720 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:07.720 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-27T13:32:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-01-27T13:32:07.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6b6406aed0 msgr2=0x7f6b6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6b6406aed0 0x7f6b6406d390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b68036000 tx=0x7f6b6803c040 comp rx=0 tx=0).stop 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 msgr2=0x7f6b781ef370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 0x7f6b781ef370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e980 tx=0x7f6b6c00ee40 comp rx=0 tx=0).stop 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 shutdown_connections 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6b6406aed0 0x7f6b6406d390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6b7815cf00 0x7f6b78157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b780c92e0 0x7f6b781ef370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 --2- 172.21.15.46:0/423484617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6b780c8f00 0x7f6b7814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 >> 172.21.15.46:0/423484617 conn(0x7f6b7808afd0 msgr2=0x7f6b780c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 shutdown_connections 2024-01-27T13:32:07.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.730+0000 7f6b7dac9640 1 -- 172.21.15.46:0/423484617 wait complete. 2024-01-27T13:32:07.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 Processor -- start 2024-01-27T13:32:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 -- start start 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd80c8f00 0x7effd80cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7effd80c92e0 0x7effd80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd80ca9f0 con 0x7effd815cf00 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd80cc9c0 con 0x7effd80c92e0 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.844+0000 7effdefb0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd8159d50 con 0x7effd80c8f00 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.845+0000 7effdcd4c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd80c8f00 0x7effd80cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.845+0000 7effdd54d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7effd815cf00 0x7effd815d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33222/0 (socket says 172.21.15.46:33222) 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.845+0000 7effdd54d640 1 -- 172.21.15.46:0/856310685 learned_addr learned my addr 172.21.15.46:0/856310685 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:07.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.845+0000 7effd7fff640 1 --2- 172.21.15.46:0/856310685 >> v2:172.21.15.78:3300/0 conn(0x7effd80c92e0 0x7effd80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.848+0000 7effdcd4c640 1 -- 172.21.15.46:0/856310685 >> v2:172.21.15.78:3300/0 conn(0x7effd80c92e0 msgr2=0x7effd80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.848+0000 7effdcd4c640 1 --2- 172.21.15.46:0/856310685 >> v2:172.21.15.78:3300/0 conn(0x7effd80c92e0 0x7effd80cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.848+0000 7effdcd4c640 1 -- 172.21.15.46:0/856310685 >> v1:172.21.15.46:6789/0 conn(0x7effd815cf00 legacy=0x7effd815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.848+0000 7effdcd4c640 1 -- 172.21.15.46:0/856310685 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80cc6e0 con 0x7effd80c8f00 2024-01-27T13:32:07.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.850+0000 7effdcd4c640 1 --2- 172.21.15.46:0/856310685 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd80c8f00 0x7effd80cf010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effcc0097a0 tx=0x7effcc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a2b5b32c05c986 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effd77fe640 1 -- 172.21.15.46:0/856310685 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc030610 con 0x7effd80c8f00 2024-01-27T13:32:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effd77fe640 1 -- 172.21.15.46:0/856310685 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc030770 con 0x7effd80c8f00 2024-01-27T13:32:07.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effd77fe640 1 -- 172.21.15.46:0/856310685 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc030b00 con 0x7effd80c8f00 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 -- 172.21.15.46:0/856310685 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd80c8f00 msgr2=0x7effd80cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 --2- 172.21.15.46:0/856310685 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd80c8f00 0x7effd80cf010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7effcc0097a0 tx=0x7effcc02b960 comp rx=0 tx=0).stop 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 -- 172.21.15.46:0/856310685 shutdown_connections 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 --2- 172.21.15.46:0/856310685 >> v2:172.21.15.78:3300/0 conn(0x7effd80c92e0 0x7effd80cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 --2- 172.21.15.46:0/856310685 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd80c8f00 0x7effd80cf010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 -- 172.21.15.46:0/856310685 >> 172.21.15.46:0/856310685 conn(0x7effd808afd0 msgr2=0x7effd808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 -- 172.21.15.46:0/856310685 shutdown_connections 2024-01-27T13:32:07.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.854+0000 7effdefb0640 1 -- 172.21.15.46:0/856310685 wait complete. 2024-01-27T13:32:07.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 Processor -- start 2024-01-27T13:32:07.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 -- start start 2024-01-27T13:32:07.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effd80c8f00 0x7effd8152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd80c92e0 0x7effd8151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd815cf00 0x7effd81532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8157f00 con 0x7effd80c8f00 2024-01-27T13:32:07.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd8157840 con 0x7effd80c92e0 2024-01-27T13:32:07.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.856+0000 7effdefb0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd8157be0 con 0x7effd815cf00 2024-01-27T13:32:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.857+0000 7effdcd4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effd80c8f00 0x7effd8152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.857+0000 7effd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd80c92e0 0x7effd8151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.857+0000 7effdd54d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd815cf00 0x7effd81532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.857+0000 7effdcd4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effd80c8f00 0x7effd8152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36992/0 (socket says 172.21.15.46:36992) 2024-01-27T13:32:07.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.857+0000 7effdcd4c640 1 -- 172.21.15.46:0/1560825614 learned_addr learned my addr 172.21.15.46:0/1560825614 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:07.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.860+0000 7effdd54d640 1 -- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd80c92e0 msgr2=0x7effd8151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.860+0000 7effdd54d640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd80c92e0 0x7effd8151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.860+0000 7effdd54d640 1 -- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effd80c8f00 msgr2=0x7effd8152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:07.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.860+0000 7effdd54d640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effd80c8f00 0x7effd8152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:07.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.860+0000 7effdd54d640 1 -- 172.21.15.46:0/1560825614 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc009400 con 0x7effd815cf00 2024-01-27T13:32:07.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.863+0000 7effdd54d640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd815cf00 0x7effd81532f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effd000cad0 tx=0x7effd000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:07.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.866+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000ac30 con 0x7effd815cf00 2024-01-27T13:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.866+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd000ad90 con 0x7effd815cf00 2024-01-27T13:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.866+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0012600 con 0x7effd815cf00 2024-01-27T13:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.866+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80c4660 con 0x7effd815cf00 2024-01-27T13:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.866+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd80c4be0 con 0x7effd815cf00 2024-01-27T13:32:07.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.867+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd8158040 con 0x7effd815cf00 2024-01-27T13:32:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.886+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7effd0007070 con 0x7effd815cf00 2024-01-27T13:32:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.886+0000 7effd57fa640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effbc06af00 0x7effbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:07.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.886+0000 7effdcd4c640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effbc06af00 0x7effbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:07.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:07.887+0000 7effdcd4c640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effbc06af00 0x7effbc06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effcc02b9a0 tx=0x7effcc03b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:08.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.109+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7effd00583c0 con 0x7effd815cf00 2024-01-27T13:32:08.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.121+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7effd0054700 con 0x7effd815cf00 2024-01-27T13:32:08.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.300+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effd8158040 con 0x7effd815cf00 2024-01-27T13:32:08.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.387+0000 7effd57fa640 1 -- 172.21.15.46:0/1560825614 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12815 (secure 0 0 0) 0x7effd8158040 con 0x7effd815cf00 2024-01-27T13:32:08.379 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:08.380 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:00.546726+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.388+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effbc06af00 msgr2=0x7effbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.388+0000 7effdefb0640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effbc06af00 0x7effbc06d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effcc02b9a0 tx=0x7effcc03b040 comp rx=0 tx=0).stop 2024-01-27T13:32:08.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd815cf00 msgr2=0x7effd81532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd815cf00 0x7effd81532f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7effd000cad0 tx=0x7effd000cf90 comp rx=0 tx=0).stop 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 shutdown_connections 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effbc06af00 0x7effbc06d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7effd815cf00 0x7effd81532f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7effd80c92e0 0x7effd8151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 --2- 172.21.15.46:0/1560825614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7effd80c8f00 0x7effd8152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 >> 172.21.15.46:0/1560825614 conn(0x7effd808afd0 msgr2=0x7effd815c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 shutdown_connections 2024-01-27T13:32:08.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.389+0000 7effdefb0640 1 -- 172.21.15.46:0/1560825614 wait complete. 2024-01-27T13:32:08.392 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-27T13:32:08.392 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:32:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.505+0000 7fad6d77c640 1 Processor -- start 2024-01-27T13:32:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.505+0000 7fad6d77c640 1 -- start start 2024-01-27T13:32:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.506+0000 7fad6d77c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad68153cd0 0x7fad680c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:08.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.506+0000 7fad6d77c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad680c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.506+0000 7fad6d77c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6815a870 con 0x7fad6806d880 2024-01-27T13:32:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.506+0000 7fad6d77c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad68159cf0 con 0x7fad68153cd0 2024-01-27T13:32:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.506+0000 7fad6d77c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad68159fd0 con 0x7fad680c9630 2024-01-27T13:32:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.507+0000 7fad66ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fad68153cd0 0x7fad680c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:08.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.507+0000 7fad667fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fad6806d880 0x7fad6815d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33234/0 (socket says 172.21.15.46:33234) 2024-01-27T13:32:08.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.507+0000 7fad667fc640 1 -- 172.21.15.46:0/3389584696 learned_addr learned my addr 172.21.15.46:0/3389584696 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.510+0000 7fad66ffd640 1 -- 172.21.15.46:0/3389584696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 msgr2=0x7fad680c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.510+0000 7fad66ffd640 1 --2- 172.21.15.46:0/3389584696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad680c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.510+0000 7fad66ffd640 1 -- 172.21.15.46:0/3389584696 >> v1:172.21.15.46:6789/0 conn(0x7fad6806d880 legacy=0x7fad6815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:08.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.510+0000 7fad66ffd640 1 -- 172.21.15.46:0/3389584696 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6815a2b0 con 0x7fad68153cd0 2024-01-27T13:32:08.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.513+0000 7fad66ffd640 1 --2- 172.21.15.46:0/3389584696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68153cd0 0x7fad680c8a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0097a0 tx=0x7fad5c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b5fdf65190f61d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:08.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad65ffb640 1 -- 172.21.15.46:0/3389584696 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c02f050 con 0x7fad68153cd0 2024-01-27T13:32:08.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad65ffb640 1 -- 172.21.15.46:0/3389584696 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c031700 con 0x7fad68153cd0 2024-01-27T13:32:08.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad65ffb640 1 -- 172.21.15.46:0/3389584696 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c031a90 con 0x7fad68153cd0 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 -- 172.21.15.46:0/3389584696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68153cd0 msgr2=0x7fad680c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3389584696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68153cd0 0x7fad680c8a80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0097a0 tx=0x7fad5c02b7a0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 -- 172.21.15.46:0/3389584696 shutdown_connections 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3389584696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad680c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3389584696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad68153cd0 0x7fad680c8a80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 -- 172.21.15.46:0/3389584696 >> 172.21.15.46:0/3389584696 conn(0x7fad6806fc00 msgr2=0x7fad68070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 -- 172.21.15.46:0/3389584696 shutdown_connections 2024-01-27T13:32:08.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.520+0000 7fad6d77c640 1 -- 172.21.15.46:0/3389584696 wait complete. 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.522+0000 7fad6d77c640 1 Processor -- start 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.522+0000 7fad6d77c640 1 -- start start 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad6d77c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 0x7fad68154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad6d77c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad6814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad6d77c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68153cd0 0x7fad681efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad6d77c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c64f0 con 0x7fad6806d880 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad6d77c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad681f3d70 con 0x7fad68153cd0 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad6d77c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad681f3410 con 0x7fad680c9630 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad667fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad6814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad66ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 0x7fad68154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad677fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68153cd0 0x7fad681efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad667fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad6814b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:58752/0 (socket says 172.21.15.46:58752) 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad66ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 0x7fad68154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37000/0 (socket says 172.21.15.46:37000) 2024-01-27T13:32:08.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.523+0000 7fad667fc640 1 -- 172.21.15.46:0/3854307567 learned_addr learned my addr 172.21.15.46:0/3854307567 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.527+0000 7fad66ffd640 1 -- 172.21.15.46:0/3854307567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 msgr2=0x7fad6814b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.527+0000 7fad66ffd640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad6814b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.527+0000 7fad66ffd640 1 -- 172.21.15.46:0/3854307567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68153cd0 msgr2=0x7fad681efe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.527+0000 7fad66ffd640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68153cd0 0x7fad681efe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:08.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.527+0000 7fad66ffd640 1 -- 172.21.15.46:0/3854307567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009400 con 0x7fad6806d880 2024-01-27T13:32:08.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.529+0000 7fad66ffd640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 0x7fad68154450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad5c033000 tx=0x7fad5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.532+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c033bb0 con 0x7fad6806d880 2024-01-27T13:32:08.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.533+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c033d50 con 0x7fad6806d880 2024-01-27T13:32:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.533+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c03c640 con 0x7fad6806d880 2024-01-27T13:32:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.533+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad68154c90 con 0x7fad6806d880 2024-01-27T13:32:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.533+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad681f3990 con 0x7fad6806d880 2024-01-27T13:32:08.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.533+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad681f3b20 con 0x7fad6806d880 2024-01-27T13:32:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.553+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fad5c03a040 con 0x7fad6806d880 2024-01-27T13:32:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.553+0000 7fad4f7fe640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fad5406aed0 0x7fad5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:08.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.553+0000 7fad667fc640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fad5406aed0 0x7fad5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:08.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.554+0000 7fad667fc640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fad5406aed0 0x7fad5406d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad6814e730 tx=0x7fad58009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:08.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.555+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad5c07a3c0 con 0x7fad6806d880 2024-01-27T13:32:08.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.808+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fad5c076700 con 0x7fad6806d880 2024-01-27T13:32:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:08.988+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad68074410 con 0x7fad6806d880 2024-01-27T13:32:09.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.009+0000 7fad4f7fe640 1 -- 172.21.15.46:0/3854307567 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad5c038020 con 0x7fad6806d880 2024-01-27T13:32:09.002 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fad5406aed0 msgr2=0x7fad5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fad5406aed0 0x7fad5406d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad6814e730 tx=0x7fad58009040 comp rx=0 tx=0).stop 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 msgr2=0x7fad68154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 0x7fad68154450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fad5c033000 tx=0x7fad5c0046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 shutdown_connections 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fad5406aed0 0x7fad5406d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad68153cd0 0x7fad681efe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fad680c9630 0x7fad6814b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 --2- 172.21.15.46:0/3854307567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6806d880 0x7fad68154450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 >> 172.21.15.46:0/3854307567 conn(0x7fad6806fc00 msgr2=0x7fad680c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:09.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 shutdown_connections 2024-01-27T13:32:09.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.011+0000 7fad6d77c640 1 -- 172.21.15.46:0/3854307567 wait complete. 2024-01-27T13:32:09.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-27T13:32:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.123+0000 7fa115de3640 1 Processor -- start 2024-01-27T13:32:09.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.123+0000 7fa115de3640 1 -- start start 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.124+0000 7fa115de3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa11014d150 0x7fa1100c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.124+0000 7fa115de3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa1100c37c0 0x7fa1101599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.124+0000 7fa115de3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1100c5ef0 con 0x7fa1100cc060 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.124+0000 7fa115de3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100c69e0 con 0x7fa11014d150 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.124+0000 7fa115de3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1100c2c20 con 0x7fa1100c37c0 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.125+0000 7fa10f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa11014d150 0x7fa1100c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.125+0000 7fa10ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa1100c37c0 0x7fa1101599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.125+0000 7fa10f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fa11014d150 0x7fa1100c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37010/0 (socket says 172.21.15.46:37010) 2024-01-27T13:32:09.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.125+0000 7fa10f7fe640 1 -- 172.21.15.46:0/1775730164 learned_addr learned my addr 172.21.15.46:0/1775730164 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.127+0000 7fa10f7fe640 1 -- 172.21.15.46:0/1775730164 >> v2:172.21.15.78:3300/0 conn(0x7fa1100c37c0 msgr2=0x7fa1101599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.127+0000 7fa10f7fe640 1 --2- 172.21.15.46:0/1775730164 >> v2:172.21.15.78:3300/0 conn(0x7fa1100c37c0 0x7fa1101599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.127+0000 7fa10f7fe640 1 -- 172.21.15.46:0/1775730164 >> v1:172.21.15.78:6789/0 conn(0x7fa1100cc060 legacy=0x7fa1100c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.127+0000 7fa10f7fe640 1 -- 172.21.15.46:0/1775730164 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100c6140 con 0x7fa11014d150 2024-01-27T13:32:09.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.129+0000 7fa10f7fe640 1 --2- 172.21.15.46:0/1775730164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa11014d150 0x7fa1100c75c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa1100669b0 tx=0x7fa10002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4b626b81293d50 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa10e7fc640 1 -- 172.21.15.46:0/1775730164 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10002f850 con 0x7fa11014d150 2024-01-27T13:32:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa10e7fc640 1 -- 172.21.15.46:0/1775730164 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10002f9b0 con 0x7fa11014d150 2024-01-27T13:32:09.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa10e7fc640 1 -- 172.21.15.46:0/1775730164 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10002fd40 con 0x7fa11014d150 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa115de3640 1 -- 172.21.15.46:0/1775730164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa11014d150 msgr2=0x7fa1100c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa115de3640 1 --2- 172.21.15.46:0/1775730164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa11014d150 0x7fa1100c75c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa1100669b0 tx=0x7fa10002ba30 comp rx=0 tx=0).stop 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa115de3640 1 -- 172.21.15.46:0/1775730164 shutdown_connections 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa115de3640 1 --2- 172.21.15.46:0/1775730164 >> v2:172.21.15.78:3300/0 conn(0x7fa1100c37c0 0x7fa1101599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa115de3640 1 --2- 172.21.15.46:0/1775730164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa11014d150 0x7fa1100c75c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.133+0000 7fa115de3640 1 -- 172.21.15.46:0/1775730164 >> 172.21.15.46:0/1775730164 conn(0x7fa1100c8620 msgr2=0x7fa1100cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:09.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.134+0000 7fa115de3640 1 -- 172.21.15.46:0/1775730164 shutdown_connections 2024-01-27T13:32:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.134+0000 7fa115de3640 1 -- 172.21.15.46:0/1775730164 wait complete. 2024-01-27T13:32:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.135+0000 7fa115de3640 1 Processor -- start 2024-01-27T13:32:09.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.135+0000 7fa115de3640 1 -- start start 2024-01-27T13:32:09.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa115de3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 0x7fa1101e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa115de3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1100cc060 0x7fa1101df240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa115de3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa11014d150 0x7fa1101ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa115de3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1101e3190 con 0x7fa1100c37c0 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa115de3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1100719c0 con 0x7fa11014d150 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa115de3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1101575c0 con 0x7fa1100cc060 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa10f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 0x7fa1101e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa10ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa11014d150 0x7fa1101ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa10effd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1100cc060 0x7fa1101df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa10f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 0x7fa1101e0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37026/0 (socket says 172.21.15.46:37026) 2024-01-27T13:32:09.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.136+0000 7fa10f7fe640 1 -- 172.21.15.46:0/2554321308 learned_addr learned my addr 172.21.15.46:0/2554321308 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.140+0000 7fa10f7fe640 1 -- 172.21.15.46:0/2554321308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1100cc060 msgr2=0x7fa1101df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.140+0000 7fa10f7fe640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1100cc060 0x7fa1101df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.140+0000 7fa10f7fe640 1 -- 172.21.15.46:0/2554321308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa11014d150 msgr2=0x7fa1101ef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.140+0000 7fa10f7fe640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa11014d150 0x7fa1101ef4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.140+0000 7fa10f7fe640 1 -- 172.21.15.46:0/2554321308 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1000094d0 con 0x7fa1100c37c0 2024-01-27T13:32:09.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.142+0000 7fa10f7fe640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 0x7fa1101e0bb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa10002ba70 tx=0x7fa100004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:09.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.146+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100037c40 con 0x7fa1100c37c0 2024-01-27T13:32:09.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.146+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa100037dc0 con 0x7fa1100c37c0 2024-01-27T13:32:09.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.146+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa100041640 con 0x7fa1100c37c0 2024-01-27T13:32:09.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.146+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa110157860 con 0x7fa1100c37c0 2024-01-27T13:32:09.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.146+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1101e27f0 con 0x7fa1100c37c0 2024-01-27T13:32:09.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.147+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1100c4a30 con 0x7fa1100c37c0 2024-01-27T13:32:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.408+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa1000417a0 con 0x7fa1100c37c0 2024-01-27T13:32:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.409+0000 7fa0f7fff640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa0fc06aed0 0x7fa0fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.409+0000 7fa10effd640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa0fc06aed0 0x7fa0fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.409+0000 7fa10effd640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa0fc06aed0 0x7fa0fc06d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa11006e950 tx=0x7fa104009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.423+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa10003c070 con 0x7fa1100c37c0 2024-01-27T13:32:09.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.423+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa100077e30 con 0x7fa1100c37c0 2024-01-27T13:32:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.604+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa1101ef300 con 0x7fa1100c37c0 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.610+0000 7fa0f7fff640 1 -- 172.21.15.46:0/2554321308 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa10007b450 con 0x7fa1100c37c0 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-27T13:32:09.603 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-01-27T13:32:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa0fc06aed0 msgr2=0x7fa0fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa0fc06aed0 0x7fa0fc06d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa11006e950 tx=0x7fa104009040 comp rx=0 tx=0).stop 2024-01-27T13:32:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 msgr2=0x7fa1101e0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 0x7fa1101e0bb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa10002ba70 tx=0x7fa100004730 comp rx=0 tx=0).stop 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 shutdown_connections 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa0fc06aed0 0x7fa0fc06d390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa11014d150 0x7fa1101ef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1100cc060 0x7fa1101df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.612+0000 7fa115de3640 1 --2- 172.21.15.46:0/2554321308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1100c37c0 0x7fa1101e0bb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.613+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 >> 172.21.15.46:0/2554321308 conn(0x7fa1100c8620 msgr2=0x7fa11006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.613+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 shutdown_connections 2024-01-27T13:32:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.613+0000 7fa115de3640 1 -- 172.21.15.46:0/2554321308 wait complete. 2024-01-27T13:32:09.615 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-27T13:32:09.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-27T13:32:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.728+0000 7f9a7cd82640 1 Processor -- start 2024-01-27T13:32:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.728+0000 7f9a7cd82640 1 -- start start 2024-01-27T13:32:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a7cd82640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9a780cbfc0 0x7f9a780c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a7cd82640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7815cc90 con 0x7f9a780cbbe0 2024-01-27T13:32:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a7cd82640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7815daf0 con 0x7f9a78153c00 2024-01-27T13:32:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a7cd82640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a780c9f40 con 0x7f9a780cbfc0 2024-01-27T13:32:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a7659c640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9a780cbbe0 0x7f9a781534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33246/0 (socket says 172.21.15.46:33246) 2024-01-27T13:32:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a7659c640 1 -- 172.21.15.46:0/1386513048 learned_addr learned my addr 172.21.15.46:0/1386513048 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.729+0000 7f9a6ffff640 1 --2- 172.21.15.46:0/1386513048 >> v2:172.21.15.78:3300/0 conn(0x7f9a780cbfc0 0x7f9a780c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.732+0000 7f9a75d9b640 1 -- 172.21.15.46:0/1386513048 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184089810 0 0) 0x7f9a7815cc90 con 0x7f9a780cbbe0 2024-01-27T13:32:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.732+0000 7f9a75d9b640 1 -- 172.21.15.46:0/1386513048 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a64003520 con 0x7f9a780cbbe0 2024-01-27T13:32:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.733+0000 7f9a6ffff640 1 -- 172.21.15.46:0/1386513048 >> v1:172.21.15.78:6789/0 conn(0x7f9a78153c00 legacy=0x7f9a7806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.733+0000 7f9a6ffff640 1 -- 172.21.15.46:0/1386513048 >> v1:172.21.15.46:6789/0 conn(0x7f9a780cbbe0 legacy=0x7f9a781534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.733+0000 7f9a6ffff640 1 -- 172.21.15.46:0/1386513048 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780670e0 con 0x7f9a780cbfc0 2024-01-27T13:32:09.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.735+0000 7f9a6ffff640 1 --2- 172.21.15.46:0/1386513048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780c9a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a600097a0 tx=0x7f9a6002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2223223fd8eb4e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:09.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.741+0000 7f9a75d9b640 1 -- 172.21.15.46:0/1386513048 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60030610 con 0x7f9a780cbfc0 2024-01-27T13:32:09.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.741+0000 7f9a75d9b640 1 -- 172.21.15.46:0/1386513048 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60030770 con 0x7f9a780cbfc0 2024-01-27T13:32:09.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.741+0000 7f9a75d9b640 1 -- 172.21.15.46:0/1386513048 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60030b00 con 0x7f9a780cbfc0 2024-01-27T13:32:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 -- 172.21.15.46:0/1386513048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 msgr2=0x7f9a780c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/1386513048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780c9a00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a600097a0 tx=0x7f9a6002b960 comp rx=0 tx=0).stop 2024-01-27T13:32:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 -- 172.21.15.46:0/1386513048 shutdown_connections 2024-01-27T13:32:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/1386513048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780c9a00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 -- 172.21.15.46:0/1386513048 >> 172.21.15.46:0/1386513048 conn(0x7f9a7808b600 msgr2=0x7f9a780663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 -- 172.21.15.46:0/1386513048 shutdown_connections 2024-01-27T13:32:09.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.742+0000 7f9a7cd82640 1 -- 172.21.15.46:0/1386513048 wait complete. 2024-01-27T13:32:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.743+0000 7f9a7cd82640 1 Processor -- start 2024-01-27T13:32:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 -- start start 2024-01-27T13:32:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9a780cbbe0 0x7f9a78159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78153c00 0x7f9a78157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78152df0 con 0x7f9a78153c00 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78155020 con 0x7f9a780cbfc0 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.744+0000 7f9a7cd82640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7815a9e0 con 0x7f9a780cbbe0 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.745+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78153c00 0x7f9a78157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.745+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.745+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9a780cbbe0 0x7f9a78159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.745+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78153c00 0x7f9a78157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37042/0 (socket says 172.21.15.46:37042) 2024-01-27T13:32:09.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.745+0000 7f9a76d9d640 1 -- 172.21.15.46:0/3400821603 learned_addr learned my addr 172.21.15.46:0/3400821603 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.748+0000 7f9a6ffff640 1 -- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9a780cbbe0 msgr2=0x7f9a78159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.748+0000 7f9a6ffff640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9a780cbbe0 0x7f9a78159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.748+0000 7f9a6ffff640 1 -- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78153c00 msgr2=0x7f9a78157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.748+0000 7f9a6ffff640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78153c00 0x7f9a78157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:09.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.748+0000 7f9a6ffff640 1 -- 172.21.15.46:0/3400821603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60009400 con 0x7f9a780cbfc0 2024-01-27T13:32:09.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.751+0000 7f9a6ffff640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780ce6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a60033000 tx=0x7f9a60004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:09.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.754+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6003e040 con 0x7f9a780cbfc0 2024-01-27T13:32:09.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.754+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60039cb0 con 0x7f9a780cbfc0 2024-01-27T13:32:09.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.754+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7815a310 con 0x7f9a780cbfc0 2024-01-27T13:32:09.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.754+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60044630 con 0x7f9a780cbfc0 2024-01-27T13:32:09.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.755+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7815af40 con 0x7f9a780cbfc0 2024-01-27T13:32:09.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.756+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a78074410 con 0x7f9a780cbfc0 2024-01-27T13:32:09.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.775+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9a6004d3b0 con 0x7f9a780cbfc0 2024-01-27T13:32:09.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.775+0000 7f9a6effd640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9a5806af20 0x7f9a5806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:09.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.775+0000 7f9a7659c640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9a5806af20 0x7f9a5806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:09.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.776+0000 7f9a7659c640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9a5806af20 0x7f9a5806d3e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a680011e0 tx=0x7f9a68007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:09.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:09.778+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a60039e20 con 0x7f9a780cbfc0 2024-01-27T13:32:10.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:10.011+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9a60076ea0 con 0x7f9a780cbfc0 2024-01-27T13:32:10.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:10.191+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9a780c5490 con 0x7f9a780cbfc0 2024-01-27T13:32:11.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.305+0000 7f9a6effd640 1 -- 172.21.15.46:0/3400821603 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9a6007a4c0 con 0x7f9a780cbfc0 2024-01-27T13:32:11.298 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9a5806af20 msgr2=0x7f9a5806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9a5806af20 0x7f9a5806d3e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9a680011e0 tx=0x7f9a68007d30 comp rx=0 tx=0).stop 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 msgr2=0x7f9a780ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780ce6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9a60033000 tx=0x7f9a60004730 comp rx=0 tx=0).stop 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 shutdown_connections 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9a5806af20 0x7f9a5806d3e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9a78153c00 0x7f9a78157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a780cbfc0 0x7f9a780ce6c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 --2- 172.21.15.46:0/3400821603 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9a780cbbe0 0x7f9a78159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 >> 172.21.15.46:0/3400821603 conn(0x7f9a7808b600 msgr2=0x7f9a780ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.307+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 shutdown_connections 2024-01-27T13:32:11.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.308+0000 7f9a7cd82640 1 -- 172.21.15.46:0/3400821603 wait complete. 2024-01-27T13:32:11.312 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-01-27T13:32:11.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.441+0000 7fe6a65ad640 1 Processor -- start 2024-01-27T13:32:11.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.441+0000 7fe6a65ad640 1 -- start start 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe6a65ad640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6a0156fc0 0x7fe6a00712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe6a65ad640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a00c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe6a65ad640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a015cf70 con 0x7fe6a00c7d40 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe6a65ad640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a00c81d0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe6a65ad640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01573a0 con 0x7fe6a00717e0 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe69ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6a0156fc0 0x7fe6a00712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.442+0000 7fe69ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe6a0156fc0 0x7fe6a00712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37044/0 (socket says 172.21.15.46:37044) 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.443+0000 7fe69ffff640 1 -- 172.21.15.46:0/2152397039 learned_addr learned my addr 172.21.15.46:0/2152397039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:11.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.443+0000 7fe69f7fe640 1 --2- 172.21.15.46:0/2152397039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a00c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:11.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.445+0000 7fe69ffff640 1 -- 172.21.15.46:0/2152397039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 msgr2=0x7fe6a00c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:11.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.445+0000 7fe69ffff640 1 --2- 172.21.15.46:0/2152397039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a00c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.445+0000 7fe69ffff640 1 -- 172.21.15.46:0/2152397039 >> v1:172.21.15.78:6789/0 conn(0x7fe6a00c7d40 legacy=0x7fe6a015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:11.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.445+0000 7fe69ffff640 1 -- 172.21.15.46:0/2152397039 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a006c520 con 0x7fe6a0156fc0 2024-01-27T13:32:11.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.447+0000 7fe69ffff640 1 --2- 172.21.15.46:0/2152397039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a00712a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe688009870 tx=0x7fe68802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af6ef8927f4f78f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:11.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.451+0000 7fe69effd640 1 -- 172.21.15.46:0/2152397039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688030840 con 0x7fe6a0156fc0 2024-01-27T13:32:11.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.451+0000 7fe69effd640 1 -- 172.21.15.46:0/2152397039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6880309a0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.451+0000 7fe69effd640 1 -- 172.21.15.46:0/2152397039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe688030d30 con 0x7fe6a0156fc0 2024-01-27T13:32:11.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 -- 172.21.15.46:0/2152397039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 msgr2=0x7fe6a00712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:11.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/2152397039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a00712a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe688009870 tx=0x7fe68802b980 comp rx=0 tx=0).stop 2024-01-27T13:32:11.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 -- 172.21.15.46:0/2152397039 shutdown_connections 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/2152397039 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a00c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/2152397039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a00712a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 -- 172.21.15.46:0/2152397039 >> 172.21.15.46:0/2152397039 conn(0x7fe6a006f310 msgr2=0x7fe6a006f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 -- 172.21.15.46:0/2152397039 shutdown_connections 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.452+0000 7fe6a65ad640 1 -- 172.21.15.46:0/2152397039 wait complete. 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.453+0000 7fe6a65ad640 1 Processor -- start 2024-01-27T13:32:11.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.453+0000 7fe6a65ad640 1 -- start start 2024-01-27T13:32:11.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a65ad640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:11.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a65ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00c7d40 0x7fe6a01f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:11.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a65ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a01f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:11.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a65ad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00c49c0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a65ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a01f2600 con 0x7fe6a00c7d40 2024-01-27T13:32:11.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a65ad640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0158280 con 0x7fe6a00717e0 2024-01-27T13:32:11.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe6a4b4a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a01f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:11.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe69ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:11.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.454+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00c7d40 0x7fe6a01f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:11.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.455+0000 7fe6a4b4a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a01f2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37058/0 (socket says 172.21.15.46:37058) 2024-01-27T13:32:11.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.455+0000 7fe6a4b4a640 1 -- 172.21.15.46:0/1217099217 learned_addr learned my addr 172.21.15.46:0/1217099217 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:11.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.458+0000 7fe6a4b4a640 1 -- 172.21.15.46:0/1217099217 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 msgr2=0x7fe6a0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:11.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.458+0000 7fe6a4b4a640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.458+0000 7fe6a4b4a640 1 -- 172.21.15.46:0/1217099217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00c7d40 msgr2=0x7fe6a01f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:11.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.458+0000 7fe6a4b4a640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00c7d40 0x7fe6a01f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:11.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.458+0000 7fe6a4b4a640 1 -- 172.21.15.46:0/1217099217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880094d0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.461+0000 7fe6a4b4a640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a01f2fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c7a0 tx=0x7fe69800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.464+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698003b70 con 0x7fe6a0156fc0 2024-01-27T13:32:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.464+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe698003cf0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.464+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69800aa90 con 0x7fe6a0156fc0 2024-01-27T13:32:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.464+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a0158540 con 0x7fe6a0156fc0 2024-01-27T13:32:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.464+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a0158b00 con 0x7fe6a0156fc0 2024-01-27T13:32:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.465+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a01f27b0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.484+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe69800abf0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.485+0000 7fe69cff9640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe68006af20 0x7fe68006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:11.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.485+0000 7fe69ffff640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe68006af20 0x7fe68006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:11.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.485+0000 7fe69ffff640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe68006af20 0x7fe68006d3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe688036000 tx=0x7fe688008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.739+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe698058890 con 0x7fe6a0156fc0 2024-01-27T13:32:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.739+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe698054bd0 con 0x7fe6a0156fc0 2024-01-27T13:32:11.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:11.926+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe6a01f2770 con 0x7fe6a0156fc0 2024-01-27T13:32:12.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.337+0000 7fe69cff9640 1 -- 172.21.15.46:0/1217099217 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe698003e60 con 0x7fe6a0156fc0 2024-01-27T13:32:12.330 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe68006af20 msgr2=0x7fe68006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe68006af20 0x7fe68006d3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe688036000 tx=0x7fe688008030 comp rx=0 tx=0).stop 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 msgr2=0x7fe6a01f2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a01f2fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe69800c7a0 tx=0x7fe69800cc60 comp rx=0 tx=0).stop 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 shutdown_connections 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe68006af20 0x7fe68006d3e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6a0156fc0 0x7fe6a01f2fd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6a00c7d40 0x7fe6a01f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 --2- 172.21.15.46:0/1217099217 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6a00717e0 0x7fe6a0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 >> 172.21.15.46:0/1217099217 conn(0x7fe6a006f310 msgr2=0x7fe6a00c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 shutdown_connections 2024-01-27T13:32:12.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.339+0000 7fe6a65ad640 1 -- 172.21.15.46:0/1217099217 wait complete. 2024-01-27T13:32:12.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-27T13:32:12.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.465+0000 7fdd60989640 1 Processor -- start 2024-01-27T13:32:12.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.465+0000 7fdd60989640 1 -- start start 2024-01-27T13:32:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.466+0000 7fdd60989640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fdd5c1518f0 0x7fdd5c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:12.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.466+0000 7fdd60989640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 0x7fdd5c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.466+0000 7fdd60989640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c070900 con 0x7fdd5c158110 2024-01-27T13:32:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.466+0000 7fdd60989640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c06b560 con 0x7fdd5c1518f0 2024-01-27T13:32:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.466+0000 7fdd60989640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c06fa40 con 0x7fdd5c0704e0 2024-01-27T13:32:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.467+0000 7fdd59d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 0x7fdd5c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:12.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.467+0000 7fdd59d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 0x7fdd5c06dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:58798/0 (socket says 172.21.15.46:58798) 2024-01-27T13:32:12.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.467+0000 7fdd59d9b640 1 -- 172.21.15.46:0/4121733275 learned_addr learned my addr 172.21.15.46:0/4121733275 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.469+0000 7fdd5a59c640 1 --2- 172.21.15.46:0/4121733275 >> v2:172.21.15.46:3300/0 conn(0x7fdd5c1518f0 0x7fdd5c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.469+0000 7fdd59d9b640 1 -- 172.21.15.46:0/4121733275 >> v2:172.21.15.46:3300/0 conn(0x7fdd5c1518f0 msgr2=0x7fdd5c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.469+0000 7fdd59d9b640 1 --2- 172.21.15.46:0/4121733275 >> v2:172.21.15.46:3300/0 conn(0x7fdd5c1518f0 0x7fdd5c0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.469+0000 7fdd59d9b640 1 -- 172.21.15.46:0/4121733275 >> v1:172.21.15.78:6789/0 conn(0x7fdd5c158110 legacy=0x7fdd5c06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:12.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.469+0000 7fdd59d9b640 1 -- 172.21.15.46:0/4121733275 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c06e880 con 0x7fdd5c0704e0 2024-01-27T13:32:12.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.472+0000 7fdd59d9b640 1 --2- 172.21.15.46:0/4121733275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 0x7fdd5c06dde0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009870 tx=0x7fdd5002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df5f30304742ed8 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.532+0000 7fdd5959a640 1 -- 172.21.15.46:0/4121733275 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50031640 con 0x7fdd5c0704e0 2024-01-27T13:32:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.533+0000 7fdd5959a640 1 -- 172.21.15.46:0/4121733275 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500317a0 con 0x7fdd5c0704e0 2024-01-27T13:32:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.533+0000 7fdd5959a640 1 -- 172.21.15.46:0/4121733275 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50031b30 con 0x7fdd5c0704e0 2024-01-27T13:32:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.533+0000 7fdd60989640 1 -- 172.21.15.46:0/4121733275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 msgr2=0x7fdd5c06dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.533+0000 7fdd60989640 1 --2- 172.21.15.46:0/4121733275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 0x7fdd5c06dde0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009870 tx=0x7fdd5002b8f0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.534+0000 7fdd60989640 1 -- 172.21.15.46:0/4121733275 shutdown_connections 2024-01-27T13:32:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.534+0000 7fdd60989640 1 --2- 172.21.15.46:0/4121733275 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c0704e0 0x7fdd5c06dde0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.534+0000 7fdd60989640 1 --2- 172.21.15.46:0/4121733275 >> v2:172.21.15.46:3300/0 conn(0x7fdd5c1518f0 0x7fdd5c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.534+0000 7fdd60989640 1 -- 172.21.15.46:0/4121733275 >> 172.21.15.46:0/4121733275 conn(0x7fdd5c0c8a10 msgr2=0x7fdd5c0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.534+0000 7fdd60989640 1 -- 172.21.15.46:0/4121733275 shutdown_connections 2024-01-27T13:32:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.534+0000 7fdd60989640 1 -- 172.21.15.46:0/4121733275 wait complete. 2024-01-27T13:32:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.535+0000 7fdd60989640 1 Processor -- start 2024-01-27T13:32:12.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.535+0000 7fdd60989640 1 -- start start 2024-01-27T13:32:12.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd60989640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd5c0704e0 0x7fdd5c1f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd60989640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c1518f0 0x7fdd5c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd60989640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 0x7fdd5c1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd60989640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c1ed2e0 con 0x7fdd5c158110 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd60989640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c1ed5a0 con 0x7fdd5c0704e0 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd60989640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c1ed880 con 0x7fdd5c1518f0 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd5ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 0x7fdd5c1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd5ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 0x7fdd5c1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37088/0 (socket says 172.21.15.46:37088) 2024-01-27T13:32:12.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.536+0000 7fdd5ad9d640 1 -- 172.21.15.46:0/362236119 learned_addr learned my addr 172.21.15.46:0/362236119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.540+0000 7fdd5ad9d640 1 -- 172.21.15.46:0/362236119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c1518f0 msgr2=0x7fdd5c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.540+0000 7fdd5ad9d640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c1518f0 0x7fdd5c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.540+0000 7fdd5ad9d640 1 -- 172.21.15.46:0/362236119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd5c0704e0 msgr2=0x7fdd5c1f1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.540+0000 7fdd5ad9d640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd5c0704e0 0x7fdd5c1f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:12.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.540+0000 7fdd5ad9d640 1 -- 172.21.15.46:0/362236119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500094d0 con 0x7fdd5c158110 2024-01-27T13:32:12.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.542+0000 7fdd5ad9d640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 0x7fdd5c1571e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400c780 tx=0x7fdd5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.593+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54004b60 con 0x7fdd5c158110 2024-01-27T13:32:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.593+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400ce90 con 0x7fdd5c158110 2024-01-27T13:32:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.593+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400a850 con 0x7fdd5c158110 2024-01-27T13:32:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.593+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c1edb60 con 0x7fdd5c158110 2024-01-27T13:32:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.593+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c1ee120 con 0x7fdd5c158110 2024-01-27T13:32:12.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.594+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c0c9db0 con 0x7fdd5c158110 2024-01-27T13:32:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.933+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdd54006b50 con 0x7fdd5c158110 2024-01-27T13:32:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.933+0000 7fdd4affd640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdd3c06af20 0x7fdd3c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.934+0000 7fdd5a59c640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdd3c06af20 0x7fdd3c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.934+0000 7fdd5a59c640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdd3c06af20 0x7fdd3c06d3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c006fd0 tx=0x7fdd4c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:12.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.946+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdd5401a3a0 con 0x7fdd5c158110 2024-01-27T13:32:12.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:12.946+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdd54054ed0 con 0x7fdd5c158110 2024-01-27T13:32:13.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.165+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdd5c0c4a20 con 0x7fdd5c158110 2024-01-27T13:32:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.783+0000 7fdd4affd640 1 -- 172.21.15.46:0/362236119 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdd540584f0 con 0x7fdd5c158110 2024-01-27T13:32:13.776 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-01-27T13:32:13.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdd3c06af20 msgr2=0x7fdd3c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdd3c06af20 0x7fdd3c06d3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c006fd0 tx=0x7fdd4c008040 comp rx=0 tx=0).stop 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 msgr2=0x7fdd5c1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 0x7fdd5c1571e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400c780 tx=0x7fdd5400cc40 comp rx=0 tx=0).stop 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 shutdown_connections 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fdd3c06af20 0x7fdd3c06d3e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd5c158110 0x7fdd5c1571e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fdd5c1518f0 0x7fdd5c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 --2- 172.21.15.46:0/362236119 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd5c0704e0 0x7fdd5c1f1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 >> 172.21.15.46:0/362236119 conn(0x7fdd5c0c8a10 msgr2=0x7fdd5c0cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 shutdown_connections 2024-01-27T13:32:13.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.786+0000 7fdd60989640 1 -- 172.21.15.46:0/362236119 wait complete. 2024-01-27T13:32:13.789 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-01-27T13:32:13.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-01-27T13:32:13.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.902+0000 7fe28c4a8640 1 Processor -- start 2024-01-27T13:32:13.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.902+0000 7fe28c4a8640 1 -- start start 2024-01-27T13:32:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.903+0000 7fe28c4a8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe284071310 0x7fe2840ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.903+0000 7fe28c4a8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28415ddf0 con 0x7fe284070f30 2024-01-27T13:32:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.903+0000 7fe28c4a8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28415a7a0 con 0x7fe2840c7870 2024-01-27T13:32:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.903+0000 7fe28c4a8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe284159f00 con 0x7fe284071310 2024-01-27T13:32:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.904+0000 7fe28a244640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe284070f30 0x7fe28415d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33260/0 (socket says 172.21.15.46:33260) 2024-01-27T13:32:13.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.904+0000 7fe28a244640 1 -- 172.21.15.46:0/881950216 learned_addr learned my addr 172.21.15.46:0/881950216 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:13.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.906+0000 7fe289242640 1 -- 172.21.15.46:0/881950216 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171399672 0 0) 0x7fe280001110 con 0x7fe284070f30 2024-01-27T13:32:13.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.906+0000 7fe289242640 1 -- 172.21.15.46:0/881950216 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe270003520 con 0x7fe284070f30 2024-01-27T13:32:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.909+0000 7fe289a43640 1 --2- 172.21.15.46:0/881950216 >> v2:172.21.15.78:3300/0 conn(0x7fe284071310 0x7fe2840ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:13.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.912+0000 7fe289a43640 1 -- 172.21.15.46:0/881950216 >> v1:172.21.15.78:6789/0 conn(0x7fe2840c7870 legacy=0x7fe284153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.912+0000 7fe289a43640 1 -- 172.21.15.46:0/881950216 >> v1:172.21.15.46:6789/0 conn(0x7fe284070f30 legacy=0x7fe28415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.912+0000 7fe289a43640 1 -- 172.21.15.46:0/881950216 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28415a1e0 con 0x7fe284071310 2024-01-27T13:32:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.917+0000 7fe289a43640 1 --2- 172.21.15.46:0/881950216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe284071310 0x7fe2840ca450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe28415a990 tx=0x7fe27802b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d7e4dc4a85554c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.921+0000 7fe289242640 1 -- 172.21.15.46:0/881950216 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278030890 con 0x7fe284071310 2024-01-27T13:32:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.921+0000 7fe289242640 1 -- 172.21.15.46:0/881950216 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2780309f0 con 0x7fe284071310 2024-01-27T13:32:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.921+0000 7fe289242640 1 -- 172.21.15.46:0/881950216 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278030d80 con 0x7fe284071310 2024-01-27T13:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 -- 172.21.15.46:0/881950216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe284071310 msgr2=0x7fe2840ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/881950216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe284071310 0x7fe2840ca450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe28415a990 tx=0x7fe27802b9d0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 -- 172.21.15.46:0/881950216 shutdown_connections 2024-01-27T13:32:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/881950216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe284071310 0x7fe2840ca450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 -- 172.21.15.46:0/881950216 >> 172.21.15.46:0/881950216 conn(0x7fe28406f070 msgr2=0x7fe28406f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 -- 172.21.15.46:0/881950216 shutdown_connections 2024-01-27T13:32:13.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.922+0000 7fe28c4a8640 1 -- 172.21.15.46:0/881950216 wait complete. 2024-01-27T13:32:13.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.924+0000 7fe28c4a8640 1 Processor -- start 2024-01-27T13:32:13.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.924+0000 7fe28c4a8640 1 -- start start 2024-01-27T13:32:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.925+0000 7fe28c4a8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe284070f30 0x7fe2840c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.925+0000 7fe28c4a8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe284071310 0x7fe28415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.925+0000 7fe28c4a8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 0x7fe2840c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.925+0000 7fe28c4a8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2841f3ab0 con 0x7fe284071310 2024-01-27T13:32:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.925+0000 7fe28c4a8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840cd6c0 con 0x7fe2840c7870 2024-01-27T13:32:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.925+0000 7fe28c4a8640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840cc860 con 0x7fe284070f30 2024-01-27T13:32:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.926+0000 7fe28aa45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 0x7fe2840c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.926+0000 7fe28a244640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe284070f30 0x7fe2840c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.926+0000 7fe28aa45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 0x7fe2840c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:34878/0 (socket says 172.21.15.46:34878) 2024-01-27T13:32:13.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.926+0000 7fe28aa45640 1 -- 172.21.15.46:0/1212482005 learned_addr learned my addr 172.21.15.46:0/1212482005 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.929+0000 7fe28aa45640 1 -- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe284070f30 msgr2=0x7fe2840c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.929+0000 7fe28aa45640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe284070f30 0x7fe2840c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.929+0000 7fe28aa45640 1 -- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe284071310 msgr2=0x7fe28415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.929+0000 7fe28aa45640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe284071310 0x7fe28415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:13.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.929+0000 7fe28aa45640 1 -- 172.21.15.46:0/1212482005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278009400 con 0x7fe2840c7870 2024-01-27T13:32:13.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.932+0000 7fe28aa45640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 0x7fe2840c63c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00c6e0 tx=0x7fe27c00cba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:13.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.935+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c003b70 con 0x7fe2840c7870 2024-01-27T13:32:13.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.935+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c003cd0 con 0x7fe2840c7870 2024-01-27T13:32:13.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.935+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c005310 con 0x7fe2840c7870 2024-01-27T13:32:13.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.935+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2841f2e30 con 0x7fe2840c7870 2024-01-27T13:32:13.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.935+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2841f33f0 con 0x7fe2840c7870 2024-01-27T13:32:13.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:13.936+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2841f3bf0 con 0x7fe2840c7870 2024-01-27T13:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.179+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe27c005470 con 0x7fe2840c7870 2024-01-27T13:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.179+0000 7fe276ffd640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe26806aed0 0x7fe26806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.180+0000 7fe28a244640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe26806aed0 0x7fe26806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:14.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.180+0000 7fe28a244640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe26806aed0 0x7fe26806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe280005880 tx=0x7fe280009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:14.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.182+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe27c058f50 con 0x7fe2840c7870 2024-01-27T13:32:14.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.193+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe27c054b90 con 0x7fe2840c7870 2024-01-27T13:32:14.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.385+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe2841f3bf0 con 0x7fe2840c7870 2024-01-27T13:32:14.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.625+0000 7fe276ffd640 1 -- 172.21.15.46:0/1212482005 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe2841f3bf0 con 0x7fe2840c7870 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe26806aed0 msgr2=0x7fe26806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe26806aed0 0x7fe26806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe280005880 tx=0x7fe280009040 comp rx=0 tx=0).stop 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 msgr2=0x7fe2840c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 0x7fe2840c63c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00c6e0 tx=0x7fe27c00cba0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 shutdown_connections 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe26806aed0 0x7fe26806d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2840c7870 0x7fe2840c63c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe284071310 0x7fe28415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 --2- 172.21.15.46:0/1212482005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe284070f30 0x7fe2840c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 >> 172.21.15.46:0/1212482005 conn(0x7fe28406f070 msgr2=0x7fe284159660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 shutdown_connections 2024-01-27T13:32:14.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.628+0000 7fe28c4a8640 1 -- 172.21.15.46:0/1212482005 wait complete. 2024-01-27T13:32:14.634 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-01-27T13:32:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.754+0000 7f201232d640 1 Processor -- start 2024-01-27T13:32:14.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.754+0000 7f201232d640 1 -- start start 2024-01-27T13:32:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.755+0000 7f201232d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f200c0c7090 0x7f200c06f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.755+0000 7f201232d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 0x7f200c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.755+0000 7f201232d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7920 0x7f200c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.755+0000 7f201232d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c15a8c0 con 0x7f200c0c7090 2024-01-27T13:32:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.755+0000 7f201232d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c15a5e0 con 0x7f200c0c7470 2024-01-27T13:32:14.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.755+0000 7f201232d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0c0fd0 con 0x7f200c0c7920 2024-01-27T13:32:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.756+0000 7f200b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 0x7f200c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.756+0000 7f20108ca640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7920 0x7f200c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.756+0000 7f200b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 0x7f200c159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49542/0 (socket says 172.21.15.46:49542) 2024-01-27T13:32:14.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.756+0000 7f200b7fe640 1 -- 172.21.15.46:0/2280326553 learned_addr learned my addr 172.21.15.46:0/2280326553 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.758+0000 7f20108ca640 1 -- 172.21.15.46:0/2280326553 >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 msgr2=0x7f200c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.758+0000 7f20108ca640 1 --2- 172.21.15.46:0/2280326553 >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 0x7f200c159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.758+0000 7f20108ca640 1 -- 172.21.15.46:0/2280326553 >> v2:172.21.15.46:3300/0 conn(0x7f200c0c7090 msgr2=0x7f200c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.758+0000 7f20108ca640 1 --2- 172.21.15.46:0/2280326553 >> v2:172.21.15.46:3300/0 conn(0x7f200c0c7090 0x7f200c06f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.758+0000 7f20108ca640 1 -- 172.21.15.46:0/2280326553 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0c12b0 con 0x7f200c0c7920 2024-01-27T13:32:14.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.758+0000 7f200b7fe640 1 --2- 172.21.15.46:0/2280326553 >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 0x7f200c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:14.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.761+0000 7f20108ca640 1 --2- 172.21.15.46:0/2280326553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7920 0x7f200c159f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f200c0c97e0 tx=0x7f200402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be0ea91af0c882f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:14.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.764+0000 7f200affd640 1 -- 172.21.15.46:0/2280326553 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200402cc60 con 0x7f200c0c7920 2024-01-27T13:32:14.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.764+0000 7f200affd640 1 -- 172.21.15.46:0/2280326553 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200402cdc0 con 0x7f200c0c7920 2024-01-27T13:32:14.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.764+0000 7f200affd640 1 -- 172.21.15.46:0/2280326553 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004034660 con 0x7f200c0c7920 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 -- 172.21.15.46:0/2280326553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7920 msgr2=0x7f200c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 --2- 172.21.15.46:0/2280326553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7920 0x7f200c159f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f200c0c97e0 tx=0x7f200402beb0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 -- 172.21.15.46:0/2280326553 shutdown_connections 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 --2- 172.21.15.46:0/2280326553 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7920 0x7f200c159f90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 --2- 172.21.15.46:0/2280326553 >> v2:172.21.15.78:3300/0 conn(0x7f200c0c7470 0x7f200c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 --2- 172.21.15.46:0/2280326553 >> v2:172.21.15.46:3300/0 conn(0x7f200c0c7090 0x7f200c06f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 -- 172.21.15.46:0/2280326553 >> 172.21.15.46:0/2280326553 conn(0x7f200c0c8a10 msgr2=0x7f200c0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 -- 172.21.15.46:0/2280326553 shutdown_connections 2024-01-27T13:32:14.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.765+0000 7f201232d640 1 -- 172.21.15.46:0/2280326553 wait complete. 2024-01-27T13:32:14.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.766+0000 7f201232d640 1 Processor -- start 2024-01-27T13:32:14.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.766+0000 7f201232d640 1 -- start start 2024-01-27T13:32:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.767+0000 7f201232d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f200c0c7090 0x7f200c158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.767+0000 7f201232d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 0x7f200c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.767+0000 7f201232d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f200c0c7920 0x7f200c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.767+0000 7f201232d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c143480 con 0x7f200c0c7090 2024-01-27T13:32:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.767+0000 7f201232d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0c3ae0 con 0x7f200c0c7920 2024-01-27T13:32:14.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.767+0000 7f201232d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0c4100 con 0x7f200c0c7470 2024-01-27T13:32:14.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.768+0000 7f200b7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 0x7f200c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:14.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.768+0000 7f20108ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f200c0c7920 0x7f200c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:14.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.768+0000 7f20108ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f200c0c7920 0x7f200c0c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49550/0 (socket says 172.21.15.46:49550) 2024-01-27T13:32:14.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.768+0000 7f200b7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 0x7f200c06b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:55612/0 (socket says 172.21.15.46:55612) 2024-01-27T13:32:14.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.768+0000 7f20108ca640 1 -- 172.21.15.46:0/1026059032 learned_addr learned my addr 172.21.15.46:0/1026059032 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:14.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.771+0000 7f200b7fe640 1 -- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f200c0c7920 msgr2=0x7f200c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:14.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.771+0000 7f200b7fe640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f200c0c7920 0x7f200c0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.771+0000 7f200b7fe640 1 -- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f200c0c7090 msgr2=0x7f200c158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:14.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.771+0000 7f200b7fe640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f200c0c7090 0x7f200c158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:14.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.771+0000 7f200b7fe640 1 -- 172.21.15.46:0/1026059032 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000094d0 con 0x7f200c0c7470 2024-01-27T13:32:14.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.774+0000 7f200b7fe640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 0x7f200c06b9d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2000010c90 tx=0x7f200000b510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.778+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000015070 con 0x7f200c0c7470 2024-01-27T13:32:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.778+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000bdb0 con 0x7f200c0c7470 2024-01-27T13:32:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.778+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000010ea0 con 0x7f200c0c7470 2024-01-27T13:32:14.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.778+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004009a70 con 0x7f200c0c7470 2024-01-27T13:32:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.778+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c158000 con 0x7f200c0c7470 2024-01-27T13:32:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.779+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c074410 con 0x7f200c0c7470 2024-01-27T13:32:14.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.807+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2000004230 con 0x7f200c0c7470 2024-01-27T13:32:14.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.807+0000 7f2008ff9640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ff806aed0 0x7f1ff806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.807+0000 7f200bfff640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ff806aed0 0x7f1ff806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:14.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.808+0000 7f200bfff640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ff806aed0 0x7f1ff806d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009710 tx=0x7f1ffc006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:14.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:14.814+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f200005c3f0 con 0x7f200c0c7470 2024-01-27T13:32:15.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:15.059+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2000058730 con 0x7f200c0c7470 2024-01-27T13:32:15.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:15.239+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f200c158000 con 0x7f200c0c7470 2024-01-27T13:32:17.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.037+0000 7f2008ff9640 1 -- 172.21.15.46:0/1026059032 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f200c158000 con 0x7f200c0c7470 2024-01-27T13:32:17.030 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' created 2024-01-27T13:32:17.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ff806aed0 msgr2=0x7f1ff806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ff806aed0 0x7f1ff806d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009710 tx=0x7f1ffc006c90 comp rx=0 tx=0).stop 2024-01-27T13:32:17.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 msgr2=0x7f200c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 0x7f200c06b9d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2000010c90 tx=0x7f200000b510 comp rx=0 tx=0).stop 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 shutdown_connections 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ff806aed0 0x7f1ff806d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f200c0c7920 0x7f200c0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f200c0c7470 0x7f200c06b9d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 --2- 172.21.15.46:0/1026059032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f200c0c7090 0x7f200c158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 >> 172.21.15.46:0/1026059032 conn(0x7f200c0c8a10 msgr2=0x7f200c14f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 shutdown_connections 2024-01-27T13:32:17.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.040+0000 7f201232d640 1 -- 172.21.15.46:0/1026059032 wait complete. 2024-01-27T13:32:17.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-01-27T13:32:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.167+0000 7f4d04dcb640 1 Processor -- start 2024-01-27T13:32:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.167+0000 7f4d04dcb640 1 -- start start 2024-01-27T13:32:17.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.168+0000 7f4d04dcb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006b820 0x7f4d0006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:17.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.168+0000 7f4d04dcb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4d000c6980 0x7f4d00156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.168+0000 7f4d04dcb640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d00156e50 con 0x7f4d0006dde0 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.168+0000 7f4d04dcb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d000c2cb0 con 0x7f4d000c6980 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.168+0000 7f4d04dcb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0006c140 con 0x7f4d0006b820 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.169+0000 7f4cfed9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4d0006dde0 0x7f4d00159af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35170/0 (socket says 172.21.15.46:35170) 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.169+0000 7f4cfed9d640 1 -- 172.21.15.46:0/642996882 learned_addr learned my addr 172.21.15.46:0/642996882 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.169+0000 7f4cfdd9b640 1 --2- 172.21.15.46:0/642996882 >> v2:172.21.15.78:3300/0 conn(0x7f4d000c6980 0x7f4d00156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:17.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.169+0000 7f4cfe59c640 1 --2- 172.21.15.46:0/642996882 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006b820 0x7f4d0006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfd59a640 1 -- 172.21.15.46:0/642996882 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003123005 0 0) 0x7f4d00156e50 con 0x7f4d0006dde0 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfd59a640 1 -- 172.21.15.46:0/642996882 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec003520 con 0x7f4d0006dde0 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfe59c640 1 -- 172.21.15.46:0/642996882 >> v2:172.21.15.78:3300/0 conn(0x7f4d000c6980 msgr2=0x7f4d00156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfe59c640 1 --2- 172.21.15.46:0/642996882 >> v2:172.21.15.78:3300/0 conn(0x7f4d000c6980 0x7f4d00156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfe59c640 1 -- 172.21.15.46:0/642996882 >> v1:172.21.15.46:6789/0 conn(0x7f4d0006dde0 legacy=0x7f4d00159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfe59c640 1 -- 172.21.15.46:0/642996882 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00157110 con 0x7f4d0006b820 2024-01-27T13:32:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.171+0000 7f4cfdd9b640 1 --2- 172.21.15.46:0/642996882 >> v2:172.21.15.78:3300/0 conn(0x7f4d000c6980 0x7f4d00156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:17.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.173+0000 7f4cfe59c640 1 --2- 172.21.15.46:0/642996882 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006b820 0x7f4d0006bc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80097a0 tx=0x7f4cf802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b502d711c6e32811 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:17.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4cfd59a640 1 -- 172.21.15.46:0/642996882 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8031830 con 0x7f4d0006b820 2024-01-27T13:32:17.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4cfd59a640 1 -- 172.21.15.46:0/642996882 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf8031990 con 0x7f4d0006b820 2024-01-27T13:32:17.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4cfd59a640 1 -- 172.21.15.46:0/642996882 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf8031d20 con 0x7f4d0006b820 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 -- 172.21.15.46:0/642996882 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006b820 msgr2=0x7f4d0006bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/642996882 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006b820 0x7f4d0006bc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80097a0 tx=0x7f4cf802b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 -- 172.21.15.46:0/642996882 shutdown_connections 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/642996882 >> v2:172.21.15.78:3300/0 conn(0x7f4d000c6980 0x7f4d00156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/642996882 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006b820 0x7f4d0006bc00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 -- 172.21.15.46:0/642996882 >> 172.21.15.46:0/642996882 conn(0x7f4d000c8a80 msgr2=0x7f4d000c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 -- 172.21.15.46:0/642996882 shutdown_connections 2024-01-27T13:32:17.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.177+0000 7f4d04dcb640 1 -- 172.21.15.46:0/642996882 wait complete. 2024-01-27T13:32:17.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 Processor -- start 2024-01-27T13:32:17.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 -- start start 2024-01-27T13:32:17.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 0x7f4d001ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006dde0 0x7f4d00146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d000c6980 0x7f4d001412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0014d590 con 0x7f4d0006b820 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001efb80 con 0x7f4d000c6980 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.179+0000 7f4d04dcb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d001efe20 con 0x7f4d0006dde0 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.180+0000 7f4cfe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 0x7f4d001ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:17.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.180+0000 7f4cfe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 0x7f4d001ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36370/0 (socket says 172.21.15.46:36370) 2024-01-27T13:32:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.180+0000 7f4cfe59c640 1 -- 172.21.15.46:0/3565638532 learned_addr learned my addr 172.21.15.46:0/3565638532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.180+0000 7f4cfed9d640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d000c6980 0x7f4d001412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:17.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.180+0000 7f4cfdd9b640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006dde0 0x7f4d00146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.184+0000 7f4cfe59c640 1 -- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006dde0 msgr2=0x7f4d00146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.184+0000 7f4cfe59c640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006dde0 0x7f4d00146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.184+0000 7f4cfe59c640 1 -- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d000c6980 msgr2=0x7f4d001412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.184+0000 7f4cfe59c640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d000c6980 0x7f4d001412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.184+0000 7f4cfe59c640 1 -- 172.21.15.46:0/3565638532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce8009400 con 0x7f4d0006b820 2024-01-27T13:32:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.186+0000 7f4cfe59c640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 0x7f4d001ed0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4cf802bee0 tx=0x7f4cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.189+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf803a630 con 0x7f4d0006b820 2024-01-27T13:32:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.189+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf803a7b0 con 0x7f4d0006b820 2024-01-27T13:32:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.189+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf803ab60 con 0x7f4d0006b820 2024-01-27T13:32:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.189+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf8009400 con 0x7f4d0006b820 2024-01-27T13:32:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.189+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d000c4ed0 con 0x7f4d0006b820 2024-01-27T13:32:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.190+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d00074410 con 0x7f4d0006b820 2024-01-27T13:32:17.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.454+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4cf803acc0 con 0x7f4d0006b820 2024-01-27T13:32:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.454+0000 7f4cf6ffd640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ce006aed0 0x7f4ce006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.454+0000 7f4cfdd9b640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ce006aed0 0x7f4ce006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:17.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.455+0000 7f4cfdd9b640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ce006aed0 0x7f4ce006d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4d000c6610 tx=0x7f4ce8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:17.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.467+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4cf807a1a0 con 0x7f4d0006b820 2024-01-27T13:32:17.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.467+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4cf80764e0 con 0x7f4d0006b820 2024-01-27T13:32:17.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.647+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4d000c1460 con 0x7f4d0006b820 2024-01-27T13:32:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.988+0000 7f4cf6ffd640 1 -- 172.21.15.46:0/3565638532 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4cf8079b00 con 0x7f4d0006b820 2024-01-27T13:32:17.980 INFO:teuthology.orchestra.run.smithi046.stderr:set pool 4 allow_ec_overwrites to true 2024-01-27T13:32:17.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ce006aed0 msgr2=0x7f4ce006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ce006aed0 0x7f4ce006d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4d000c6610 tx=0x7f4ce8009190 comp rx=0 tx=0).stop 2024-01-27T13:32:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 msgr2=0x7f4d001ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 0x7f4d001ed0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4cf802bee0 tx=0x7f4cf80046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 shutdown_connections 2024-01-27T13:32:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ce006aed0 0x7f4ce006d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d000c6980 0x7f4d001412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4d0006dde0 0x7f4d00146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.990+0000 7f4d04dcb640 1 --2- 172.21.15.46:0/3565638532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d0006b820 0x7f4d001ed0e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.991+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 >> 172.21.15.46:0/3565638532 conn(0x7f4d000c8a80 msgr2=0x7f4d0006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.991+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 shutdown_connections 2024-01-27T13:32:17.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:17.991+0000 7f4d04dcb640 1 -- 172.21.15.46:0/3565638532 wait complete. 2024-01-27T13:32:17.994 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-01-27T13:32:18.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.120+0000 7f80bb1d5640 1 Processor -- start 2024-01-27T13:32:18.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.120+0000 7f80bb1d5640 1 -- start start 2024-01-27T13:32:18.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.121+0000 7f80bb1d5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80b40c8f00 0x7f80b40cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.121+0000 7f80bb1d5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80b40c92e0 0x7f80b40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.121+0000 7f80bb1d5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 0x7f80b415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.121+0000 7f80bb1d5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b40cc9c0 con 0x7f80b40c8f00 2024-01-27T13:32:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.121+0000 7f80bb1d5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b40ca9f0 con 0x7f80b40c92e0 2024-01-27T13:32:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.121+0000 7f80bb1d5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4159d50 con 0x7f80b415cf00 2024-01-27T13:32:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.150+0000 7f80b3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80b40c92e0 0x7f80b40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.150+0000 7f80b3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80b40c92e0 0x7f80b40cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49578/0 (socket says 172.21.15.46:49578) 2024-01-27T13:32:18.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.150+0000 7f80b3fff640 1 -- 172.21.15.46:0/3318996288 learned_addr learned my addr 172.21.15.46:0/3318996288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:18.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.152+0000 7f80b3fff640 1 -- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 msgr2=0x7f80b415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:18.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.152+0000 7f80b3fff640 1 --2- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 0x7f80b415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.152+0000 7f80b3fff640 1 -- 172.21.15.46:0/3318996288 >> v2:172.21.15.46:3300/0 conn(0x7f80b40c8f00 msgr2=0x7f80b40cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:18.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.152+0000 7f80b3fff640 1 --2- 172.21.15.46:0/3318996288 >> v2:172.21.15.46:3300/0 conn(0x7f80b40c8f00 0x7f80b40cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.152+0000 7f80b3fff640 1 -- 172.21.15.46:0/3318996288 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40cc6e0 con 0x7f80b40c92e0 2024-01-27T13:32:18.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.155+0000 7f80b3fff640 1 --2- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c92e0 0x7f80b40cf550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80b408bb10 tx=0x7f80a002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec21b7f882e71bae server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.167+0000 7f80b37fe640 1 -- 172.21.15.46:0/3318996288 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0030860 con 0x7f80b40c92e0 2024-01-27T13:32:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.167+0000 7f80b37fe640 1 -- 172.21.15.46:0/3318996288 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a00309c0 con 0x7f80b40c92e0 2024-01-27T13:32:18.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.167+0000 7f80b37fe640 1 -- 172.21.15.46:0/3318996288 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0030d50 con 0x7f80b40c92e0 2024-01-27T13:32:18.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 -- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c92e0 msgr2=0x7f80b40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c92e0 0x7f80b40cf550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80b408bb10 tx=0x7f80a002b9a0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 -- 172.21.15.46:0/3318996288 shutdown_connections 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 0x7f80b415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/3318996288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c92e0 0x7f80b40cf550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/3318996288 >> v2:172.21.15.46:3300/0 conn(0x7f80b40c8f00 0x7f80b40cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 -- 172.21.15.46:0/3318996288 >> 172.21.15.46:0/3318996288 conn(0x7f80b408afd0 msgr2=0x7f80b408b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 -- 172.21.15.46:0/3318996288 shutdown_connections 2024-01-27T13:32:18.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.168+0000 7f80bb1d5640 1 -- 172.21.15.46:0/3318996288 wait complete. 2024-01-27T13:32:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.169+0000 7f80bb1d5640 1 Processor -- start 2024-01-27T13:32:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.169+0000 7f80bb1d5640 1 -- start start 2024-01-27T13:32:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.170+0000 7f80bb1d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 0x7f80b41ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.170+0000 7f80bb1d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c92e0 0x7f80b40ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.170+0000 7f80bb1d5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 0x7f80b4155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.170+0000 7f80bb1d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4155550 con 0x7f80b40c92e0 2024-01-27T13:32:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.170+0000 7f80bb1d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40ab830 con 0x7f80b40c8f00 2024-01-27T13:32:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.170+0000 7f80bb1d5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4155eb0 con 0x7f80b415cf00 2024-01-27T13:32:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.171+0000 7f80b8f71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 0x7f80b41ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:18.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.171+0000 7f80b8f71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 0x7f80b41ef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49588/0 (socket says 172.21.15.46:49588) 2024-01-27T13:32:18.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.171+0000 7f80b8f71640 1 -- 172.21.15.46:0/2677269473 learned_addr learned my addr 172.21.15.46:0/2677269473 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:18.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.174+0000 7f80b3fff640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c92e0 0x7f80b40ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:18.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.175+0000 7f80b8f71640 1 -- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 msgr2=0x7f80b4155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:18.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.175+0000 7f80b8f71640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 0x7f80b4155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.175+0000 7f80b8f71640 1 -- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c92e0 msgr2=0x7f80b40ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:18.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.175+0000 7f80b8f71640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c92e0 0x7f80b40ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:18.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.175+0000 7f80b8f71640 1 -- 172.21.15.46:0/2677269473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00094d0 con 0x7f80b40c8f00 2024-01-27T13:32:18.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.178+0000 7f80b8f71640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 0x7f80b41ef390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80a800b410 tx=0x7f80a800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.182+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8011830 con 0x7f80b40c8f00 2024-01-27T13:32:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.182+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a80119b0 con 0x7f80b40c8f00 2024-01-27T13:32:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.182+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b4154330 con 0x7f80b40c8f00 2024-01-27T13:32:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.182+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8011d60 con 0x7f80b40c8f00 2024-01-27T13:32:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.182+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b41548d0 con 0x7f80b40c8f00 2024-01-27T13:32:18.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.183+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b4155690 con 0x7f80b40c8f00 2024-01-27T13:32:18.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.202+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f80a801a400 con 0x7f80b40c8f00 2024-01-27T13:32:18.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.203+0000 7f80b17fa640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f809806af50 0x7f809806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:18.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.203+0000 7f80b3fff640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f809806af50 0x7f809806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:18.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.203+0000 7f80b3fff640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f809806af50 0x7f809806d410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80a0036000 tx=0x7f80a0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.206+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f80a8058e20 con 0x7f80b40c8f00 2024-01-27T13:32:18.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.465+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f80a8054a60 con 0x7f80b40c8f00 2024-01-27T13:32:18.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:18.683+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f80b4155690 con 0x7f80b40c8f00 2024-01-27T13:32:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.383+0000 7f80b17fa640 1 -- 172.21.15.46:0/2677269473 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f80a8015020 con 0x7f80b40c8f00 2024-01-27T13:32:19.376 INFO:teuthology.orchestra.run.smithi046.stderr:added data pool 4 to fsmap 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f809806af50 msgr2=0x7f809806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f809806af50 0x7f809806d410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80a0036000 tx=0x7f80a0008030 comp rx=0 tx=0).stop 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 msgr2=0x7f80b41ef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 0x7f80b41ef390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80a800b410 tx=0x7f80a800b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 shutdown_connections 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f809806af50 0x7f809806d410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80b415cf00 0x7f80b4155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b40c92e0 0x7f80b40ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 --2- 172.21.15.46:0/2677269473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80b40c8f00 0x7f80b41ef390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 >> 172.21.15.46:0/2677269473 conn(0x7f80b408afd0 msgr2=0x7f80b40cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:19.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 shutdown_connections 2024-01-27T13:32:19.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.385+0000 7f80bb1d5640 1 -- 172.21.15.46:0/2677269473 wait complete. 2024-01-27T13:32:19.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:32:19.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 Processor -- start 2024-01-27T13:32:19.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 -- start start 2024-01-27T13:32:19.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:19.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93a40c81e0 0x7f93a406ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:19.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a40c7620 con 0x7f93a40c99d0 2024-01-27T13:32:19.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a40c67b0 con 0x7f93a40c81e0 2024-01-27T13:32:19.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.499+0000 7f93aaa55640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40ca180 con 0x7f93a4153b80 2024-01-27T13:32:19.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.500+0000 7f93a8ff2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f93a40c81e0 0x7f93a406ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:19.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.500+0000 7f93a37fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f93a40c99d0 0x7f93a40c7ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:59262/0 (socket says 172.21.15.46:59262) 2024-01-27T13:32:19.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.500+0000 7f93a37fe640 1 -- 172.21.15.46:0/1645045721 learned_addr learned my addr 172.21.15.46:0/1645045721 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:19.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.500+0000 7f93a3fff640 1 --2- 172.21.15.46:0/1645045721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:19.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.503+0000 7f93a8ff2640 1 -- 172.21.15.46:0/1645045721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 msgr2=0x7f93a41598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:19.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.503+0000 7f93a8ff2640 1 --2- 172.21.15.46:0/1645045721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.503+0000 7f93a8ff2640 1 -- 172.21.15.46:0/1645045721 >> v1:172.21.15.78:6789/0 conn(0x7f93a40c99d0 legacy=0x7f93a40c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:19.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.503+0000 7f93a8ff2640 1 -- 172.21.15.46:0/1645045721 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40ca460 con 0x7f93a40c81e0 2024-01-27T13:32:19.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.505+0000 7f93a8ff2640 1 --2- 172.21.15.46:0/1645045721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c81e0 0x7f93a406ba60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f939c009d90 tx=0x7f939c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3571234f57c69d99 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:19.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93a2ffd640 1 -- 172.21.15.46:0/1645045721 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c02cbc0 con 0x7f93a40c81e0 2024-01-27T13:32:19.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93a2ffd640 1 -- 172.21.15.46:0/1645045721 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c02cd20 con 0x7f93a40c81e0 2024-01-27T13:32:19.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93a2ffd640 1 -- 172.21.15.46:0/1645045721 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c034660 con 0x7f93a40c81e0 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 -- 172.21.15.46:0/1645045721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c81e0 msgr2=0x7f93a406ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1645045721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c81e0 0x7f93a406ba60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f939c009d90 tx=0x7f939c02be10 comp rx=0 tx=0).stop 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 -- 172.21.15.46:0/1645045721 shutdown_connections 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1645045721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c81e0 0x7f93a406ba60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1645045721 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 -- 172.21.15.46:0/1645045721 >> 172.21.15.46:0/1645045721 conn(0x7f93a40cf230 msgr2=0x7f93a40cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:19.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 -- 172.21.15.46:0/1645045721 shutdown_connections 2024-01-27T13:32:19.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.509+0000 7f93aaa55640 1 -- 172.21.15.46:0/1645045721 wait complete. 2024-01-27T13:32:19.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 Processor -- start 2024-01-27T13:32:19.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 -- start start 2024-01-27T13:32:19.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a40c81e0 0x7f93a414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c99d0 0x7f93a41ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a41f3440 con 0x7f93a40c99d0 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4156c90 con 0x7f93a40c81e0 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.511+0000 7f93aaa55640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4156f50 con 0x7f93a4153b80 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.512+0000 7f93a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c99d0 0x7f93a41ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.512+0000 7f93a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a40c81e0 0x7f93a414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.512+0000 7f93a8ff2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.512+0000 7f93a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c99d0 0x7f93a41ef2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36396/0 (socket says 172.21.15.46:36396) 2024-01-27T13:32:19.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.512+0000 7f93a37fe640 1 -- 172.21.15.46:0/1043059692 learned_addr learned my addr 172.21.15.46:0/1043059692 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:19.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.515+0000 7f93a8ff2640 1 -- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a40c81e0 msgr2=0x7f93a414fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:19.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.515+0000 7f93a8ff2640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a40c81e0 0x7f93a414fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.515+0000 7f93a8ff2640 1 -- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c99d0 msgr2=0x7f93a41ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:19.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.515+0000 7f93a8ff2640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c99d0 0x7f93a41ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:19.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.515+0000 7f93a8ff2640 1 -- 172.21.15.46:0/1043059692 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c009a70 con 0x7f93a4153b80 2024-01-27T13:32:19.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.518+0000 7f93a8ff2640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41ef7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93a406d750 tx=0x7f939c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:19.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.521+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c040650 con 0x7f93a4153b80 2024-01-27T13:32:19.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.521+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c02ce90 con 0x7f93a4153b80 2024-01-27T13:32:19.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.521+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0409f0 con 0x7f93a4153b80 2024-01-27T13:32:19.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.521+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a41f27c0 con 0x7f93a4153b80 2024-01-27T13:32:19.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.521+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a41f2d80 con 0x7f93a4153b80 2024-01-27T13:32:19.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.522+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a4067ca0 con 0x7f93a4153b80 2024-01-27T13:32:19.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.541+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f939c040b50 con 0x7f93a4153b80 2024-01-27T13:32:19.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.541+0000 7f93a0ff9640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f939006af50 0x7f939006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.541+0000 7f93a3fff640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f939006af50 0x7f939006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:19.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.542+0000 7f93a3fff640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f939006af50 0x7f939006d410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9394009aa0 tx=0x7f9394009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:19.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.765+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f939c07b160 con 0x7f93a4153b80 2024-01-27T13:32:19.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.774+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f939c0774a0 con 0x7f93a4153b80 2024-01-27T13:32:19.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:19.995+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93a4074410 con 0x7f93a4153b80 2024-01-27T13:32:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.022+0000 7f93a0ff9640 1 -- 172.21.15.46:0/1043059692 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6511 (secure 0 0 0) 0x7f939c009450 con 0x7f93a4153b80 2024-01-27T13:32:20.015 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:20.015 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:18.712911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-27T13:32:20.016 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f939006af50 msgr2=0x7f939006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f939006af50 0x7f939006d410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9394009aa0 tx=0x7f9394009190 comp rx=0 tx=0).stop 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 msgr2=0x7f93a41ef7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41ef7f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f93a406d750 tx=0x7f939c004a40 comp rx=0 tx=0).stop 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 shutdown_connections 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f939006af50 0x7f939006d410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f93a4153b80 0x7f93a41ef7f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f93a40c99d0 0x7f93a41ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 --2- 172.21.15.46:0/1043059692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93a40c81e0 0x7f93a414fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 >> 172.21.15.46:0/1043059692 conn(0x7f93a40cf230 msgr2=0x7f93a4148640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:20.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 shutdown_connections 2024-01-27T13:32:20.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.025+0000 7f93aaa55640 1 -- 172.21.15.46:0/1043059692 wait complete. 2024-01-27T13:32:20.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.141+0000 7f17742ee640 1 Processor -- start 2024-01-27T13:32:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.141+0000 7f17742ee640 1 -- start start 2024-01-27T13:32:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.142+0000 7f17742ee640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f176c153be0 0x7f176c0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.142+0000 7f17742ee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0c77c0 con 0x7f176c0c9020 2024-01-27T13:32:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.142+0000 7f17742ee640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0c7cf0 con 0x7f176c070c80 2024-01-27T13:32:20.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.142+0000 7f17742ee640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c159b60 con 0x7f176c153be0 2024-01-27T13:32:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.168+0000 7f177208a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f176c153be0 0x7f176c0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.168+0000 7f177208a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f176c153be0 0x7f176c0ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49604/0 (socket says 172.21.15.46:49604) 2024-01-27T13:32:20.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.168+0000 7f177208a640 1 -- 172.21.15.46:0/3856402268 learned_addr learned my addr 172.21.15.46:0/3856402268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.172+0000 7f177208a640 1 -- 172.21.15.46:0/3856402268 >> v1:172.21.15.78:6789/0 conn(0x7f176c070c80 legacy=0x7f176c164100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.172+0000 7f177208a640 1 -- 172.21.15.46:0/3856402268 >> v1:172.21.15.46:6789/0 conn(0x7f176c0c9020 legacy=0x7f176c159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:20.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.172+0000 7f177208a640 1 -- 172.21.15.46:0/3856402268 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0c7a10 con 0x7f176c153be0 2024-01-27T13:32:20.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.177+0000 7f177208a640 1 --2- 172.21.15.46:0/3856402268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c153be0 0x7f176c0ca3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1768009870 tx=0x7f176802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc8b4034424328b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:20.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f1771088640 1 -- 172.21.15.46:0/3856402268 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768030860 con 0x7f176c153be0 2024-01-27T13:32:20.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f1771088640 1 -- 172.21.15.46:0/3856402268 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17680309c0 con 0x7f176c153be0 2024-01-27T13:32:20.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f1771088640 1 -- 172.21.15.46:0/3856402268 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768030d50 con 0x7f176c153be0 2024-01-27T13:32:20.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f17742ee640 1 -- 172.21.15.46:0/3856402268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c153be0 msgr2=0x7f176c0ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f17742ee640 1 --2- 172.21.15.46:0/3856402268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c153be0 0x7f176c0ca3a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1768009870 tx=0x7f176802b9a0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f17742ee640 1 -- 172.21.15.46:0/3856402268 shutdown_connections 2024-01-27T13:32:20.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f17742ee640 1 --2- 172.21.15.46:0/3856402268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c153be0 0x7f176c0ca3a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.183+0000 7f17742ee640 1 -- 172.21.15.46:0/3856402268 >> 172.21.15.46:0/3856402268 conn(0x7f176c06f030 msgr2=0x7f176c06f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:20.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.184+0000 7f17742ee640 1 -- 172.21.15.46:0/3856402268 shutdown_connections 2024-01-27T13:32:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.184+0000 7f17742ee640 1 -- 172.21.15.46:0/3856402268 wait complete. 2024-01-27T13:32:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.185+0000 7f17742ee640 1 Processor -- start 2024-01-27T13:32:20.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.185+0000 7f17742ee640 1 -- start start 2024-01-27T13:32:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.186+0000 7f17742ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 0x7f176c1e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.186+0000 7f17742ee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f176c0c9020 0x7f176c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.186+0000 7f17742ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176c153be0 0x7f176c149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.186+0000 7f17742ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c157d80 con 0x7f176c153be0 2024-01-27T13:32:20.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.186+0000 7f17742ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c154bd0 con 0x7f176c070c80 2024-01-27T13:32:20.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.186+0000 7f17742ee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c157ac0 con 0x7f176c0c9020 2024-01-27T13:32:20.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.187+0000 7f177208a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 0x7f176c1e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.188+0000 7f177208a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 0x7f176c1e6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49614/0 (socket says 172.21.15.46:49614) 2024-01-27T13:32:20.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.188+0000 7f177208a640 1 -- 172.21.15.46:0/2059395830 learned_addr learned my addr 172.21.15.46:0/2059395830 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:20.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.189+0000 7f1771889640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f176c0c9020 0x7f176c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.189+0000 7f177288b640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176c153be0 0x7f176c149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.192+0000 7f177208a640 1 -- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f176c0c9020 msgr2=0x7f176c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.192+0000 7f177208a640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f176c0c9020 0x7f176c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.192+0000 7f177208a640 1 -- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176c153be0 msgr2=0x7f176c149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.192+0000 7f177208a640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176c153be0 0x7f176c149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.192+0000 7f177208a640 1 -- 172.21.15.46:0/2059395830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680094d0 con 0x7f176c070c80 2024-01-27T13:32:20.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.194+0000 7f177208a640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 0x7f176c1e6ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1768009870 tx=0x7f1768004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.197+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768039e20 con 0x7f176c070c80 2024-01-27T13:32:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.198+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768043400 con 0x7f176c070c80 2024-01-27T13:32:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.198+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c1e5d10 con 0x7f176c070c80 2024-01-27T13:32:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.198+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680437b0 con 0x7f176c070c80 2024-01-27T13:32:20.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.198+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c1e62d0 con 0x7f176c070c80 2024-01-27T13:32:20.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.198+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c074410 con 0x7f176c070c80 2024-01-27T13:32:20.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.439+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1768043910 con 0x7f176c070c80 2024-01-27T13:32:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.439+0000 7f1762ffd640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f175006af20 0x7f175006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.439+0000 7f1771889640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f175006af20 0x7f175006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.440+0000 7f1771889640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f175006af20 0x7f175006d3e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f175c007fd0 tx=0x7f175c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:20.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.443+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f176803e070 con 0x7f176c070c80 2024-01-27T13:32:20.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.452+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1768078170 con 0x7f176c070c80 2024-01-27T13:32:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.636+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f176c0c7270 con 0x7f176c070c80 2024-01-27T13:32:20.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.684+0000 7f1762ffd640 1 -- 172.21.15.46:0/2059395830 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f1768034090 con 0x7f176c070c80 2024-01-27T13:32:20.677 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:20.677 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:20.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f175006af20 msgr2=0x7f175006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f175006af20 0x7f175006d3e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f175c007fd0 tx=0x7f175c009040 comp rx=0 tx=0).stop 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 msgr2=0x7f176c1e6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 0x7f176c1e6ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1768009870 tx=0x7f1768004730 comp rx=0 tx=0).stop 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 shutdown_connections 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f175006af20 0x7f175006d3e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f176c153be0 0x7f176c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f176c0c9020 0x7f176c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 --2- 172.21.15.46:0/2059395830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c070c80 0x7f176c1e6ad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 >> 172.21.15.46:0/2059395830 conn(0x7f176c06f030 msgr2=0x7f176c159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 shutdown_connections 2024-01-27T13:32:20.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.686+0000 7f17742ee640 1 -- 172.21.15.46:0/2059395830 wait complete. 2024-01-27T13:32:20.690 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:20.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.799+0000 7f13c6c6e640 1 Processor -- start 2024-01-27T13:32:20.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.799+0000 7f13c6c6e640 1 -- start start 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c6c6e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c01598e0 0x7f13c00c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c6c6e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f13c00c8010 0x7f13c006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c6c6e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00c7620 con 0x7f13c0153b80 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c6c6e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c00c67b0 con 0x7f13c00c8010 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c6c6e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c00c8440 con 0x7f13c01598e0 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c4a0a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f13c0153b80 0x7f13c00c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35196/0 (socket says 172.21.15.46:35196) 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.800+0000 7f13c4a0a640 1 -- 172.21.15.46:0/3922421992 learned_addr learned my addr 172.21.15.46:0/3922421992 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.801+0000 7f13c520b640 1 --2- 172.21.15.46:0/3922421992 >> v2:172.21.15.78:3300/0 conn(0x7f13c00c8010 0x7f13c006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.801+0000 7f13b7fff640 1 --2- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c01598e0 0x7f13c00c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.803+0000 7f13b77fe640 1 -- 172.21.15.46:0/3922421992 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556026012 0 0) 0x7f13c00c7620 con 0x7f13c0153b80 2024-01-27T13:32:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.803+0000 7f13b77fe640 1 -- 172.21.15.46:0/3922421992 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a8003520 con 0x7f13c0153b80 2024-01-27T13:32:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.803+0000 7f13c520b640 1 -- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c01598e0 msgr2=0x7f13c00c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.803+0000 7f13c520b640 1 --2- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c01598e0 0x7f13c00c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.803+0000 7f13c520b640 1 -- 172.21.15.46:0/3922421992 >> v1:172.21.15.46:6789/0 conn(0x7f13c0153b80 legacy=0x7f13c00c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.803+0000 7f13c520b640 1 -- 172.21.15.46:0/3922421992 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00ca180 con 0x7f13c00c8010 2024-01-27T13:32:20.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.805+0000 7f13c520b640 1 --2- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c00c8010 0x7f13c006ba60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009d90 tx=0x7f13b802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1dff0d8631577f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:20.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13b77fe640 1 -- 172.21.15.46:0/3922421992 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b802cbc0 con 0x7f13c00c8010 2024-01-27T13:32:20.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13b77fe640 1 -- 172.21.15.46:0/3922421992 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b802cd20 con 0x7f13c00c8010 2024-01-27T13:32:20.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13b77fe640 1 -- 172.21.15.46:0/3922421992 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8034660 con 0x7f13c00c8010 2024-01-27T13:32:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 -- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c00c8010 msgr2=0x7f13c006ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c00c8010 0x7f13c006ba60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13b8009d90 tx=0x7f13b802be10 comp rx=0 tx=0).stop 2024-01-27T13:32:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 -- 172.21.15.46:0/3922421992 shutdown_connections 2024-01-27T13:32:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c00c8010 0x7f13c006ba60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/3922421992 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c01598e0 0x7f13c00c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 -- 172.21.15.46:0/3922421992 >> 172.21.15.46:0/3922421992 conn(0x7f13c00cf230 msgr2=0x7f13c00cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:20.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 -- 172.21.15.46:0/3922421992 shutdown_connections 2024-01-27T13:32:20.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.809+0000 7f13c6c6e640 1 -- 172.21.15.46:0/3922421992 wait complete. 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.810+0000 7f13c6c6e640 1 Processor -- start 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 -- start start 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 0x7f13c0145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c0153b80 0x7f13c01ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c01598e0 0x7f13c0151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c01f2750 con 0x7f13c00c8010 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c01f2ff0 con 0x7f13c01598e0 2024-01-27T13:32:20.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.811+0000 7f13c6c6e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c014cc50 con 0x7f13c0153b80 2024-01-27T13:32:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.812+0000 7f13c4a0a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 0x7f13c0145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.812+0000 7f13c4a0a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 0x7f13c0145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36420/0 (socket says 172.21.15.46:36420) 2024-01-27T13:32:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.812+0000 7f13c4a0a640 1 -- 172.21.15.46:0/4257988022 learned_addr learned my addr 172.21.15.46:0/4257988022 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.812+0000 7f13c520b640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c01598e0 0x7f13c0151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.812+0000 7f13b7fff640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c0153b80 0x7f13c01ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.816+0000 7f13c520b640 1 -- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c0153b80 msgr2=0x7f13c01ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.816+0000 7f13c520b640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c0153b80 0x7f13c01ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.816+0000 7f13c520b640 1 -- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 msgr2=0x7f13c0145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.816+0000 7f13c520b640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 0x7f13c0145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.816+0000 7f13c520b640 1 -- 172.21.15.46:0/4257988022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b8009a70 con 0x7f13c01598e0 2024-01-27T13:32:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.816+0000 7f13c4a0a640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 0x7f13c0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:20.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.818+0000 7f13c520b640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c01598e0 0x7f13c0151b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13b8033000 tx=0x7f13b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:20.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.821+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b8040650 con 0x7f13c01598e0 2024-01-27T13:32:20.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.821+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b802ce90 con 0x7f13c01598e0 2024-01-27T13:32:20.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.821+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c014cef0 con 0x7f13c01598e0 2024-01-27T13:32:20.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.821+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b80409f0 con 0x7f13c01598e0 2024-01-27T13:32:20.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.822+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c01f29a0 con 0x7f13c01598e0 2024-01-27T13:32:20.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.822+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c0067ca0 con 0x7f13c01598e0 2024-01-27T13:32:20.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.840+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f13b8040b50 con 0x7f13c01598e0 2024-01-27T13:32:20.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.841+0000 7f13b57fa640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f13ac06af20 0x7f13ac06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:20.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.841+0000 7f13c4a0a640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f13ac06af20 0x7f13ac06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:20.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.841+0000 7f13c4a0a640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f13ac06af20 0x7f13ac06d3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005880 tx=0x7f13bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:20.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:20.843+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13b807b230 con 0x7f13c01598e0 2024-01-27T13:32:21.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.080+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f13b8077570 con 0x7f13c01598e0 2024-01-27T13:32:21.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.265+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13c0074410 con 0x7f13c01598e0 2024-01-27T13:32:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.304+0000 7f13b57fa640 1 -- 172.21.15.46:0/4257988022 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f13b8044090 con 0x7f13c01598e0 2024-01-27T13:32:21.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:21.297 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f13ac06af20 msgr2=0x7f13ac06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f13ac06af20 0x7f13ac06d3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005880 tx=0x7f13bc009040 comp rx=0 tx=0).stop 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c01598e0 msgr2=0x7f13c0151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c01598e0 0x7f13c0151b80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13b8033000 tx=0x7f13b8004a40 comp rx=0 tx=0).stop 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 shutdown_connections 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f13ac06af20 0x7f13ac06d3e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13c01598e0 0x7f13c0151b80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f13c0153b80 0x7f13c01ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 --2- 172.21.15.46:0/4257988022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13c00c8010 0x7f13c0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 >> 172.21.15.46:0/4257988022 conn(0x7f13c00cf230 msgr2=0x7f13c00cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 shutdown_connections 2024-01-27T13:32:21.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.306+0000 7f13c6c6e640 1 -- 172.21.15.46:0/4257988022 wait complete. 2024-01-27T13:32:21.324 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:32:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.443+0000 7f6e31d61640 1 Processor -- start 2024-01-27T13:32:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.443+0000 7f6e31d61640 1 -- start start 2024-01-27T13:32:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.444+0000 7f6e31d61640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e2c0c8f00 0x7f6e2c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:21.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.444+0000 7f6e31d61640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e2c0c92e0 0x7f6e2c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:21.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.444+0000 7f6e31d61640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0ca9f0 con 0x7f6e2c15cf00 2024-01-27T13:32:21.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.444+0000 7f6e31d61640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c0cc9c0 con 0x7f6e2c0c8f00 2024-01-27T13:32:21.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.444+0000 7f6e31d61640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c159d50 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.445+0000 7f6e2affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6e2c0c92e0 0x7f6e2c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:21.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.445+0000 7f6e2b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e2c0c8f00 0x7f6e2c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:21.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.445+0000 7f6e2bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6e2c15cf00 0x7f6e2c15d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35198/0 (socket says 172.21.15.46:35198) 2024-01-27T13:32:21.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.445+0000 7f6e2bfff640 1 -- 172.21.15.46:0/1751771636 learned_addr learned my addr 172.21.15.46:0/1751771636 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:21.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.447+0000 7f6e2affd640 1 -- 172.21.15.46:0/1751771636 >> v2:172.21.15.46:3300/0 conn(0x7f6e2c0c8f00 msgr2=0x7f6e2c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:21.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.447+0000 7f6e2affd640 1 --2- 172.21.15.46:0/1751771636 >> v2:172.21.15.46:3300/0 conn(0x7f6e2c0c8f00 0x7f6e2c0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.447+0000 7f6e2affd640 1 -- 172.21.15.46:0/1751771636 >> v1:172.21.15.46:6789/0 conn(0x7f6e2c15cf00 legacy=0x7f6e2c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.447+0000 7f6e2affd640 1 -- 172.21.15.46:0/1751771636 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0cc6e0 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.449+0000 7f6e2affd640 1 --2- 172.21.15.46:0/1751771636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c0c92e0 0x7f6e2c0cf550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c08bb10 tx=0x7f6e2002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f1658ca6bff507 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:21.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e2a7fc640 1 -- 172.21.15.46:0/1751771636 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20030610 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e2a7fc640 1 -- 172.21.15.46:0/1751771636 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20030770 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e2a7fc640 1 -- 172.21.15.46:0/1751771636 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20030b00 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 -- 172.21.15.46:0/1751771636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c0c92e0 msgr2=0x7f6e2c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 --2- 172.21.15.46:0/1751771636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c0c92e0 0x7f6e2c0cf550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c08bb10 tx=0x7f6e2002b960 comp rx=0 tx=0).stop 2024-01-27T13:32:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 -- 172.21.15.46:0/1751771636 shutdown_connections 2024-01-27T13:32:21.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 --2- 172.21.15.46:0/1751771636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c0c92e0 0x7f6e2c0cf550 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 --2- 172.21.15.46:0/1751771636 >> v2:172.21.15.46:3300/0 conn(0x7f6e2c0c8f00 0x7f6e2c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 -- 172.21.15.46:0/1751771636 >> 172.21.15.46:0/1751771636 conn(0x7f6e2c08afd0 msgr2=0x7f6e2c08b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 -- 172.21.15.46:0/1751771636 shutdown_connections 2024-01-27T13:32:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.453+0000 7f6e31d61640 1 -- 172.21.15.46:0/1751771636 wait complete. 2024-01-27T13:32:21.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.454+0000 7f6e31d61640 1 Processor -- start 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 -- start start 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2c0c8f00 0x7f6e2c0c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e2c0c92e0 0x7f6e2c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c15cf00 0x7f6e2c1e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c1ef370 con 0x7f6e2c0c8f00 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c1ef8a0 con 0x7f6e2c15cf00 2024-01-27T13:32:21.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.455+0000 7f6e31d61640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c1510c0 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.456+0000 7f6e2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2c0c8f00 0x7f6e2c0c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.456+0000 7f6e2b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2c0c8f00 0x7f6e2c0c3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36432/0 (socket says 172.21.15.46:36432) 2024-01-27T13:32:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.456+0000 7f6e2b7fe640 1 -- 172.21.15.46:0/3781812580 learned_addr learned my addr 172.21.15.46:0/3781812580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.456+0000 7f6e2affd640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e2c0c92e0 0x7f6e2c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:21.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.457+0000 7f6e2bfff640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c15cf00 0x7f6e2c1e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.460+0000 7f6e2affd640 1 -- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c15cf00 msgr2=0x7f6e2c1e32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.460+0000 7f6e2affd640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c15cf00 0x7f6e2c1e32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.460+0000 7f6e2affd640 1 -- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2c0c8f00 msgr2=0x7f6e2c0c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.460+0000 7f6e2affd640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2c0c8f00 0x7f6e2c0c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.460+0000 7f6e2affd640 1 -- 172.21.15.46:0/3781812580 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009400 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.464+0000 7f6e2affd640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e2c0c92e0 0x7f6e2c150b80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e20033000 tx=0x7f6e20004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:21.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.467+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2003e040 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.468+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e20039cb0 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.468+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20044630 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.468+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c1ef5c0 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.468+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c0c3aa0 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.468+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c074410 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.488+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6e2004d3b0 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.488+0000 7f6e13fff640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6e1806af50 0x7f6e1806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:21.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.488+0000 7f6e2b7fe640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6e1806af50 0x7f6e1806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:21.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.489+0000 7f6e2b7fe640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6e1806af50 0x7f6e1806d410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c006fd0 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:21.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.715+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6e20039e20 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.726+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6e20076f40 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.950+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e2c15b290 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.962+0000 7f6e13fff640 1 -- 172.21.15.46:0/3781812580 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6511 (secure 0 0 0) 0x7f6e20049090 con 0x7f6e2c0c92e0 2024-01-27T13:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:21.955 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:18.712911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-01-27T13:32:21.955 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-01-27T13:32:21.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6e1806af50 msgr2=0x7f6e1806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6e1806af50 0x7f6e1806d410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c006fd0 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2024-01-27T13:32:21.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e2c0c92e0 msgr2=0x7f6e2c150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:21.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e2c0c92e0 0x7f6e2c150b80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e20033000 tx=0x7f6e20004730 comp rx=0 tx=0).stop 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 shutdown_connections 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6e1806af50 0x7f6e1806d410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e2c15cf00 0x7f6e2c1e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e2c0c92e0 0x7f6e2c150b80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 --2- 172.21.15.46:0/3781812580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e2c0c8f00 0x7f6e2c0c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 >> 172.21.15.46:0/3781812580 conn(0x7f6e2c08afd0 msgr2=0x7f6e2c1534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.964+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 shutdown_connections 2024-01-27T13:32:21.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:21.965+0000 7f6e31d61640 1 -- 172.21.15.46:0/3781812580 wait complete. 2024-01-27T13:32:21.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:22.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.075+0000 7f7673ac2640 1 Processor -- start 2024-01-27T13:32:22.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.076+0000 7f7673ac2640 1 -- start start 2024-01-27T13:32:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.076+0000 7f7673ac2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c153b80 0x7f766c1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.076+0000 7f7673ac2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c0c7620 con 0x7f766c0c81e0 2024-01-27T13:32:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.076+0000 7f7673ac2640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766c0ca180 con 0x7f766c0c99d0 2024-01-27T13:32:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.076+0000 7f7673ac2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c0c67b0 con 0x7f766c153b80 2024-01-27T13:32:22.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.077+0000 7f767205f640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f766c0c81e0 0x7f766c06ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:35204/0 (socket says 172.21.15.46:35204) 2024-01-27T13:32:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.077+0000 7f767205f640 1 -- 172.21.15.46:0/2372785623 learned_addr learned my addr 172.21.15.46:0/2372785623 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:22.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.077+0000 7f767185e640 1 --2- 172.21.15.46:0/2372785623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c153b80 0x7f766c1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.079+0000 7f767085c640 1 -- 172.21.15.46:0/2372785623 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519704939 0 0) 0x7f766c0c7620 con 0x7f766c0c81e0 2024-01-27T13:32:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.080+0000 7f767085c640 1 -- 172.21.15.46:0/2372785623 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7654003520 con 0x7f766c0c81e0 2024-01-27T13:32:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.080+0000 7f767185e640 1 -- 172.21.15.46:0/2372785623 >> v1:172.21.15.78:6789/0 conn(0x7f766c0c99d0 legacy=0x7f766c0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.080+0000 7f767185e640 1 -- 172.21.15.46:0/2372785623 >> v1:172.21.15.46:6789/0 conn(0x7f766c0c81e0 legacy=0x7f766c06ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.080+0000 7f767185e640 1 -- 172.21.15.46:0/2372785623 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c0ca460 con 0x7f766c153b80 2024-01-27T13:32:22.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.082+0000 7f767185e640 1 --2- 172.21.15.46:0/2372785623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c153b80 0x7f766c1598e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76640097d0 tx=0x7f766402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b477adb76b241f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.084+0000 7f767085c640 1 -- 172.21.15.46:0/2372785623 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664031800 con 0x7f766c153b80 2024-01-27T13:32:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.086+0000 7f767085c640 1 -- 172.21.15.46:0/2372785623 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7664031960 con 0x7f766c153b80 2024-01-27T13:32:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.086+0000 7f767085c640 1 -- 172.21.15.46:0/2372785623 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7664031cd0 con 0x7f766c153b80 2024-01-27T13:32:22.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 -- 172.21.15.46:0/2372785623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c153b80 msgr2=0x7f766c1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 --2- 172.21.15.46:0/2372785623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c153b80 0x7f766c1598e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76640097d0 tx=0x7f766402b8a0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 -- 172.21.15.46:0/2372785623 shutdown_connections 2024-01-27T13:32:22.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 --2- 172.21.15.46:0/2372785623 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c153b80 0x7f766c1598e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 -- 172.21.15.46:0/2372785623 >> 172.21.15.46:0/2372785623 conn(0x7f766c0cf230 msgr2=0x7f766c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:22.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 -- 172.21.15.46:0/2372785623 shutdown_connections 2024-01-27T13:32:22.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.087+0000 7f7673ac2640 1 -- 172.21.15.46:0/2372785623 wait complete. 2024-01-27T13:32:22.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.088+0000 7f7673ac2640 1 Processor -- start 2024-01-27T13:32:22.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.088+0000 7f7673ac2640 1 -- start start 2024-01-27T13:32:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f7673ac2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c0c81e0 0x7f766c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f7673ac2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766c0c99d0 0x7f766c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f7673ac2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f766c153b80 0x7f766c158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f7673ac2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c15d9f0 con 0x7f766c153b80 2024-01-27T13:32:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f7673ac2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766c1ef270 con 0x7f766c0c99d0 2024-01-27T13:32:22.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f7673ac2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766c15c840 con 0x7f766c0c81e0 2024-01-27T13:32:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f767205f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f766c153b80 0x7f766c158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f767185e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c0c81e0 0x7f766c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f767105d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766c0c99d0 0x7f766c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f767205f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f766c153b80 0x7f766c158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36444/0 (socket says 172.21.15.46:36444) 2024-01-27T13:32:22.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.089+0000 7f767205f640 1 -- 172.21.15.46:0/4079878941 learned_addr learned my addr 172.21.15.46:0/4079878941 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.093+0000 7f767105d640 1 -- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c0c81e0 msgr2=0x7f766c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.093+0000 7f767105d640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c0c81e0 0x7f766c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.093+0000 7f767105d640 1 -- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f766c153b80 msgr2=0x7f766c158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.093+0000 7f767105d640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f766c153b80 0x7f766c158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.093+0000 7f767105d640 1 -- 172.21.15.46:0/4079878941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7664009400 con 0x7f766c0c99d0 2024-01-27T13:32:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.095+0000 7f767105d640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766c0c99d0 0x7f766c156f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f766000c370 tx=0x7f766000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.099+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600052d0 con 0x7f766c0c99d0 2024-01-27T13:32:22.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.099+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660005450 con 0x7f766c0c99d0 2024-01-27T13:32:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.099+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660007260 con 0x7f766c0c99d0 2024-01-27T13:32:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.099+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766c1f2910 con 0x7f766c0c99d0 2024-01-27T13:32:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.099+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c1f2ed0 con 0x7f766c0c99d0 2024-01-27T13:32:22.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.100+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766c067ca0 con 0x7f766c0c99d0 2024-01-27T13:32:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.339+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f76600073c0 con 0x7f766c0c99d0 2024-01-27T13:32:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.340+0000 7f766a7fc640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f765806af20 0x7f765806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:22.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.340+0000 7f767185e640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f765806af20 0x7f765806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:22.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.340+0000 7f767185e640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f765806af20 0x7f765806d3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7664036000 tx=0x7f7664008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:22.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.343+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7660057a20 con 0x7f766c0c99d0 2024-01-27T13:32:22.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.354+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7660053d60 con 0x7f766c0c99d0 2024-01-27T13:32:22.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.542+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f766c1ef3b0 con 0x7f766c0c99d0 2024-01-27T13:32:22.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.580+0000 7f766a7fc640 1 -- 172.21.15.46:0/4079878941 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f7660020020 con 0x7f766c0c99d0 2024-01-27T13:32:22.573 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:22.573 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:22.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.581+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f765806af20 msgr2=0x7f765806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.581+0000 7f7673ac2640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f765806af20 0x7f765806d3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7664036000 tx=0x7f7664008030 comp rx=0 tx=0).stop 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766c0c99d0 msgr2=0x7f766c156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766c0c99d0 0x7f766c156f60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f766000c370 tx=0x7f766000c830 comp rx=0 tx=0).stop 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 shutdown_connections 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f765806af20 0x7f765806d3e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f766c153b80 0x7f766c158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766c0c99d0 0x7f766c156f60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 --2- 172.21.15.46:0/4079878941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f766c0c81e0 0x7f766c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 >> 172.21.15.46:0/4079878941 conn(0x7f766c0cf230 msgr2=0x7f766c151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 shutdown_connections 2024-01-27T13:32:22.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:22.582+0000 7f7673ac2640 1 -- 172.21.15.46:0/4079878941 wait complete. 2024-01-27T13:32:23.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-27T13:32:13.208332+0000', 'modified': '2024-01-27T13:32:18.712911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.46:6837/3746495433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 3746495433}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 3746495433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-01-27T13:32:23.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-27T13:32:23.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-27T13:32:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.306+0000 7f1000f2c640 1 Processor -- start 2024-01-27T13:32:23.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.306+0000 7f1000f2c640 1 -- start start 2024-01-27T13:32:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.307+0000 7f1000f2c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0ffc0c8f00 0x7f0ffc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.307+0000 7f1000f2c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ffc0ca9f0 con 0x7f0ffc0c92e0 2024-01-27T13:32:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.307+0000 7f1000f2c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ffc159d50 con 0x7f0ffc0cf550 2024-01-27T13:32:23.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.307+0000 7f1000f2c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc0cc9c0 con 0x7f0ffc0c8f00 2024-01-27T13:32:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.308+0000 7f0ffad9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0ffc0cf550 0x7f0ffc0cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:59282/0 (socket says 172.21.15.46:59282) 2024-01-27T13:32:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.308+0000 7f0ffad9d640 1 -- 172.21.15.46:0/3545480176 learned_addr learned my addr 172.21.15.46:0/3545480176 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:23.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.308+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/3545480176 >> v2:172.21.15.46:3300/0 conn(0x7f0ffc0c8f00 0x7f0ffc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.310+0000 7f0ff959a640 1 -- 172.21.15.46:0/3545480176 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757767364 0 0) 0x7f0ffc159d50 con 0x7f0ffc0cf550 2024-01-27T13:32:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.310+0000 7f0ff959a640 1 -- 172.21.15.46:0/3545480176 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe8003520 con 0x7f0ffc0cf550 2024-01-27T13:32:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.311+0000 7f0ffa59c640 1 -- 172.21.15.46:0/3545480176 >> v1:172.21.15.78:6789/0 conn(0x7f0ffc0cf550 legacy=0x7f0ffc0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.311+0000 7f0ffa59c640 1 -- 172.21.15.46:0/3545480176 >> v1:172.21.15.46:6789/0 conn(0x7f0ffc0c92e0 legacy=0x7f0ffc15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.311+0000 7f0ffa59c640 1 -- 172.21.15.46:0/3545480176 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0cc6e0 con 0x7f0ffc0c8f00 2024-01-27T13:32:23.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.313+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/3545480176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc0cf010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40097a0 tx=0x7f0ff402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5fdba2571d0593 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.316+0000 7f0ff959a640 1 -- 172.21.15.46:0/3545480176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff402f810 con 0x7f0ffc0c8f00 2024-01-27T13:32:23.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.318+0000 7f0ff959a640 1 -- 172.21.15.46:0/3545480176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff402f970 con 0x7f0ffc0c8f00 2024-01-27T13:32:23.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.318+0000 7f0ff959a640 1 -- 172.21.15.46:0/3545480176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff402fce0 con 0x7f0ffc0c8f00 2024-01-27T13:32:23.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 -- 172.21.15.46:0/3545480176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0c8f00 msgr2=0x7f0ffc0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 --2- 172.21.15.46:0/3545480176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc0cf010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40097a0 tx=0x7f0ff402b9f0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 -- 172.21.15.46:0/3545480176 shutdown_connections 2024-01-27T13:32:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 --2- 172.21.15.46:0/3545480176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc0cf010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 -- 172.21.15.46:0/3545480176 >> 172.21.15.46:0/3545480176 conn(0x7f0ffc08afd0 msgr2=0x7f0ffc08b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 -- 172.21.15.46:0/3545480176 shutdown_connections 2024-01-27T13:32:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.319+0000 7f1000f2c640 1 -- 172.21.15.46:0/3545480176 wait complete. 2024-01-27T13:32:23.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.320+0000 7f1000f2c640 1 Processor -- start 2024-01-27T13:32:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.320+0000 7f1000f2c640 1 -- start start 2024-01-27T13:32:23.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.321+0000 7f1000f2c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc1ec960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.321+0000 7f1000f2c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ffc0c92e0 0x7f0ffc156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.321+0000 7f1000f2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 0x7f0ffc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.321+0000 7f1000f2c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b2e80 con 0x7f0ffc0cf550 2024-01-27T13:32:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.321+0000 7f1000f2c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc1f1800 con 0x7f0ffc0c8f00 2024-01-27T13:32:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.321+0000 7f1000f2c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc1f1c90 con 0x7f0ffc0c92e0 2024-01-27T13:32:23.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.322+0000 7f0ffad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 0x7f0ffc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.322+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ffc0c92e0 0x7f0ffc156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.322+0000 7f0ffad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 0x7f0ffc156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36462/0 (socket says 172.21.15.46:36462) 2024-01-27T13:32:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.322+0000 7f0ffad9d640 1 -- 172.21.15.46:0/978752507 learned_addr learned my addr 172.21.15.46:0/978752507 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.322+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc1ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.325+0000 7f0ffad9d640 1 -- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ffc0c92e0 msgr2=0x7f0ffc156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.325+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ffc0c92e0 0x7f0ffc156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.325+0000 7f0ffad9d640 1 -- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ffc0c8f00 msgr2=0x7f0ffc1ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.325+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc1ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.325+0000 7f0ffad9d640 1 -- 172.21.15.46:0/978752507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009400 con 0x7f0ffc0cf550 2024-01-27T13:32:23.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.328+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 0x7f0ffc156ac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00caa0 tx=0x7f0fec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.332+0000 7f0ff2ffd640 1 -- 172.21.15.46:0/978752507 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00ac00 con 0x7f0ffc0cf550 2024-01-27T13:32:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.332+0000 7f0ff2ffd640 1 -- 172.21.15.46:0/978752507 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00ad60 con 0x7f0ffc0cf550 2024-01-27T13:32:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.332+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc0c7bd0 con 0x7f0ffc0cf550 2024-01-27T13:32:23.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.332+0000 7f0ff2ffd640 1 -- 172.21.15.46:0/978752507 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec012620 con 0x7f0ffc0cf550 2024-01-27T13:32:23.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.332+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc1f0bf0 con 0x7f0ffc0cf550 2024-01-27T13:32:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.334+0000 7f1003bc8740 1 Processor -- start 2024-01-27T13:32:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 -- start start 2024-01-27T13:32:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb33d750 0x562bbb37f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb37df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb2ac030 con 0x562bbb33d750 2024-01-27T13:32:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb2a9720 con 0x562bbb37ecb0 2024-01-27T13:32:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.335+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bbb2a5010 con 0x562bbb37f090 2024-01-27T13:32:23.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.336+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.336+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb37df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.336+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49676/0 (socket says 172.21.15.46:49676) 2024-01-27T13:32:23.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.336+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/1433966100 learned_addr learned my addr 172.21.15.46:0/1433966100 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.338+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 msgr2=0x562bbb37df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.338+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb37df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.338+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/1433966100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb33d750 msgr2=0x562bbb37f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.338+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb33d750 0x562bbb37f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.338+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/1433966100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bbb267680 con 0x562bbb37ecb0 2024-01-27T13:32:23.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.341+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33ea50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0c96c0 tx=0x7f0fe4001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496bb76a57ff948c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.344+0000 7f0fdbfff640 1 -- 172.21.15.46:0/1433966100 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4005310 con 0x562bbb37ecb0 2024-01-27T13:32:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.344+0000 7f0fdbfff640 1 -- 172.21.15.46:0/1433966100 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4005490 con 0x562bbb37ecb0 2024-01-27T13:32:23.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.344+0000 7f0fdbfff640 1 -- 172.21.15.46:0/1433966100 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4007270 con 0x562bbb37ecb0 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 -- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 msgr2=0x562bbb33ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33ea50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0c96c0 tx=0x7f0fe4001120 comp rx=0 tx=0).stop 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 -- 172.21.15.46:0/1433966100 shutdown_connections 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb37df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb33d750 0x562bbb37f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1433966100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33ea50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 -- 172.21.15.46:0/1433966100 >> 172.21.15.46:0/1433966100 conn(0x562bbb33a8c0 msgr2=0x562bbb33e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 -- 172.21.15.46:0/1433966100 shutdown_connections 2024-01-27T13:32:23.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.345+0000 7f1003bc8740 1 -- 172.21.15.46:0/1433966100 wait complete. 2024-01-27T13:32:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.346+0000 7f1003bc8740 1 -- start start 2024-01-27T13:32:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.346+0000 7f1003bc8740 1 Processor -- start 2024-01-27T13:32:23.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb35dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb3889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb388f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb25e5f0 con 0x562bbb3664b0 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb25e290 con 0x562bbb37f090 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bbb223300 con 0x562bbb37ecb0 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f1003bc8740 10 client.0 _ll_register_callbacks cb 0x562bbb259260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb35dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.347+0000 7f0ffa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb3889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.348+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb35dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:55720/0 (socket says 172.21.15.46:55720) 2024-01-27T13:32:23.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.348+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/1954922505 learned_addr learned my addr 172.21.15.46:0/1954922505 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.351+0000 7f0ffa59c640 1 -- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 msgr2=0x562bbb35dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.351+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb35dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.351+0000 7f0ffa59c640 1 -- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 msgr2=0x562bbb388f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.351+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb388f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.351+0000 7f0ffa59c640 1 -- 172.21.15.46:0/1954922505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe400f040 con 0x562bbb37f090 2024-01-27T13:32:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.353+0000 7f0ff2ffd640 1 -- 172.21.15.46:0/978752507 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0fec007070 con 0x7f0ffc0cf550 2024-01-27T13:32:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.353+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb3889c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc08c3d0 tx=0x7f0ff40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8779375c30606b19 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.353+0000 7f0fd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-01-27T13:32:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.354+0000 7f0ff2ffd640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0fdc06ae70 0x7f0fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.354+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0fdc06ae70 0x7f0fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.354+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0fdc06ae70 0x7f0fdc06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4018fd0 tx=0x7f0fe400c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.357+0000 7f0ff2ffd640 1 -- 172.21.15.46:0/978752507 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fec058150 con 0x7f0ffc0cf550 2024-01-27T13:32:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.357+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1954922505 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff403d070 con 0x562bbb37f090 2024-01-27T13:32:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.357+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1954922505 <== mon.1 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ff402fe10 con 0x562bbb37f090 2024-01-27T13:32:23.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.357+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bbb29dea0 con 0x562bbb37f090 2024-01-27T13:32:23.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.359+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1954922505 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ff4004450 con 0x562bbb37f090 2024-01-27T13:32:23.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.359+0000 7f1003bc8740 10 client.4387 fetch_fsmap learned FSMap version 7 2024-01-27T13:32:23.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.359+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562bbb2a3690 con 0x562bbb37f090 2024-01-27T13:32:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1954922505 <== mon.1 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562bbb29dea0 con 0x562bbb37f090 2024-01-27T13:32:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1954922505 <== mon.1 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f0ff4035020 con 0x562bbb37f090 2024-01-27T13:32:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f1003bc8740 10 client.4387 fetch_fsmap finished waiting for FSMap version 7 2024-01-27T13:32:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f1003bc8740 10 client.4387 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-27T13:32:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f1003bc8740 20 client.4387 populate_metadata read hostname 'smithi046' 2024-01-27T13:32:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb392820 0x562bbb392c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f1003bc8740 4 client.4387 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T13:32:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.371+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 --> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bbb29dbc0 con 0x562bbb392820 2024-01-27T13:32:23.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.380+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb392820 0x562bbb392c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.469+0000 7f0fd97fa640 10 client.4387 ms_handle_connect on v2:172.21.15.46:6836/3746495433 2024-01-27T13:32:23.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.469+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb392820 0x562bbb392c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fc688d2e76940e4 server_cookie=9fcd8c78604eb3cb in_seq=0 out_seq=0 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1954922505 <== mds.0 v2:172.21.15.46:6836/3746495433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562bbb29dbc0 con 0x562bbb392820 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f0fd97fa640 10 client.4387 handle_command_reply: tid=0 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 client.4387 shutdown 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 msgr2=0x562bbb3889c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb3889c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc08c3d0 tx=0x7f0ff40046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 shutdown_connections 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb388f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb392820 0x562bbb392c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb3889c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1954922505 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb35dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f0fd97fa640 0 client.4387 ms_handle_reset on v2:172.21.15.46:6836/3746495433 2024-01-27T13:32:23.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 >> 172.21.15.46:0/1954922505 conn(0x562bbb33d750 msgr2=0x562bbb366a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 shutdown_connections 2024-01-27T13:32:23.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 1 -- 172.21.15.46:0/1954922505 wait complete. 2024-01-27T13:32:23.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.592+0000 7f1003bc8740 20 client.4387 trim_cache size 0 max 16384 2024-01-27T13:32:23.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.608+0000 7f1003bc8740 1 Processor -- start 2024-01-27T13:32:23.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.608+0000 7f1003bc8740 1 -- start start 2024-01-27T13:32:23.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb33db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f1003bc8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb364760 con 0x562bbb3664b0 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb366310 con 0x562bbb37ecb0 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bbb37fa30 con 0x562bbb37f090 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.609+0000 7f0ffad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.610+0000 7f0ffad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:55734/0 (socket says 172.21.15.46:55734) 2024-01-27T13:32:23.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.610+0000 7f0ffad9d640 1 -- 172.21.15.46:0/3700575013 learned_addr learned my addr 172.21.15.46:0/3700575013 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.612+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 msgr2=0x562bbb338ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.612+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.612+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/3700575013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 msgr2=0x562bbb33db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.612+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb33db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.612+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/3700575013 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bbb35ea10 con 0x562bbb37ecb0 2024-01-27T13:32:23.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.612+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:23.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.614+0000 7f0ff9d9b640 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33e070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4001160 tx=0x7f0fe4009000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=889a4b8af1444ed8 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.617+0000 7f0fdb7fe640 1 -- 172.21.15.46:0/3700575013 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4036070 con 0x562bbb37ecb0 2024-01-27T13:32:23.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.617+0000 7f0fdb7fe640 1 -- 172.21.15.46:0/3700575013 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe40052f0 con 0x562bbb37ecb0 2024-01-27T13:32:23.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.617+0000 7f0fdb7fe640 1 -- 172.21.15.46:0/3700575013 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40074e0 con 0x562bbb37ecb0 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 -- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 msgr2=0x562bbb33e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33e070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4001160 tx=0x7f0fe4009000 comp rx=0 tx=0).stop 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 -- 172.21.15.46:0/3700575013 shutdown_connections 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37ecb0 0x562bbb33e070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 --2- 172.21.15.46:0/3700575013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb33db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 -- 172.21.15.46:0/3700575013 >> 172.21.15.46:0/3700575013 conn(0x562bbb33d750 msgr2=0x562bbb38ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 -- 172.21.15.46:0/3700575013 shutdown_connections 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 -- 172.21.15.46:0/3700575013 wait complete. 2024-01-27T13:32:23.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.618+0000 7f1003bc8740 1 -- start start 2024-01-27T13:32:23.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 Processor -- start 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb3674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb37dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb37e700 con 0x562bbb3664b0 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bbb33b9c0 con 0x562bbb37f090 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bbb37e230 con 0x562bbb37ecb0 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.619+0000 7f1003bc8740 10 client.0 _ll_register_callbacks cb 0x7f0fe4001640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.620+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb37dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.620+0000 7f0ffad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.620+0000 7f0ff9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb37dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:55746/0 (socket says 172.21.15.46:55746) 2024-01-27T13:32:23.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.620+0000 7f0ff9d9b640 1 -- 172.21.15.46:0/1536561105 learned_addr learned my addr 172.21.15.46:0/1536561105 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.622+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb3674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.623+0000 7f0ffad9d640 1 -- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 msgr2=0x562bbb37dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.623+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb37dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.623+0000 7f0ffad9d640 1 -- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 msgr2=0x562bbb3674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.623+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb3674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.623+0000 7f0ffad9d640 1 -- 172.21.15.46:0/1536561105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc1f0bf0 con 0x562bbb37f090 2024-01-27T13:32:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.626+0000 7f0ffad9d640 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb338ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0fec054600 tx=0x7f0fec057be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6acac68a2237b7ad server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.626+0000 7f0fd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-01-27T13:32:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.629+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1536561105 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec06f070 con 0x562bbb37f090 2024-01-27T13:32:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.629+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1536561105 <== mon.1 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fec057840 con 0x562bbb37f090 2024-01-27T13:32:23.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.629+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fe4005490 con 0x562bbb37f090 2024-01-27T13:32:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.630+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1536561105 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fec058680 con 0x562bbb37f090 2024-01-27T13:32:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.630+0000 7f1003bc8740 10 client.4393 fetch_fsmap learned FSMap version 7 2024-01-27T13:32:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.630+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562bbb267680 con 0x562bbb37f090 2024-01-27T13:32:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1536561105 <== mon.1 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4005490 con 0x562bbb37f090 2024-01-27T13:32:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1536561105 <== mon.1 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f0fec05ff10 con 0x562bbb37f090 2024-01-27T13:32:23.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f1003bc8740 10 client.4393 fetch_fsmap finished waiting for FSMap version 7 2024-01-27T13:32:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f1003bc8740 10 client.4393 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-27T13:32:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f1003bc8740 20 client.4393 populate_metadata read hostname 'smithi046' 2024-01-27T13:32:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb3ecec0 0x562bbb3ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f1003bc8740 4 client.4393 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T13:32:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 --> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562bbafa46c0 con 0x562bbb3ecec0 2024-01-27T13:32:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.635+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb3ecec0 0x562bbb3ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.638+0000 7f0ffa59c640 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb3ecec0 0x562bbb3ed2a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5295e9b715ef8f35 server_cookie=3502de224a809726 in_seq=0 out_seq=0 2024-01-27T13:32:23.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.638+0000 7f0fd97fa640 10 client.4393 ms_handle_connect on v2:172.21.15.46:6836/3746495433 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.656+0000 7f0fd97fa640 1 -- 172.21.15.46:0/1536561105 <== mds.0 v2:172.21.15.46:6836/3746495433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x562bbafa46c0 con 0x562bbb3ecec0 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.656+0000 7f0fd97fa640 10 client.4393 handle_command_reply: tid=0 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 client.4393 shutdown 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 msgr2=0x562bbb338ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb338ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0fec054600 tx=0x7f0fec057be0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 shutdown_connections 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x562bbb3ecec0 0x562bbb3ed2a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562bbb37f090 0x562bbb338ae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x562bbb37ecb0 0x562bbb37dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f0fd97fa640 0 client.4393 ms_handle_reset on v2:172.21.15.46:6836/3746495433 2024-01-27T13:32:23.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 --2- 172.21.15.46:0/1536561105 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562bbb3664b0 0x562bbb3674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 >> 172.21.15.46:0/1536561105 conn(0x562bbb33d750 msgr2=0x562bbb378610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 shutdown_connections 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 1 -- 172.21.15.46:0/1536561105 wait complete. 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1003bc8740 20 client.4393 trim_cache size 0 max 16384 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "cd306d9e-23fd-46fc-bd31-5e5759cfb03c", 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4282, 2024-01-27T13:32:23.651 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 9.6731430889999999, 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 7, 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 25, 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 25, 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 17.431880072999999 2024-01-27T13:32:23.652 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T13:32:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0fdc06ae70 msgr2=0x7f0fdc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1000f2c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0fdc06ae70 0x7f0fdc06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4018fd0 tx=0x7f0fe400c000 comp rx=0 tx=0).stop 2024-01-27T13:32:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 msgr2=0x7f0ffc156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.657+0000 7f1000f2c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 0x7f0ffc156ac0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00caa0 tx=0x7f0fec00cf60 comp rx=0 tx=0).stop 2024-01-27T13:32:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 shutdown_connections 2024-01-27T13:32:23.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0fdc06ae70 0x7f0fdc06d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ffc0cf550 0x7f0ffc156ac0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0ffc0c92e0 0x7f0ffc156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 --2- 172.21.15.46:0/978752507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ffc0c8f00 0x7f0ffc1ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 >> 172.21.15.46:0/978752507 conn(0x7f0ffc08afd0 msgr2=0x7f0ffc0c7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 shutdown_connections 2024-01-27T13:32:23.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.658+0000 7f1000f2c640 1 -- 172.21.15.46:0/978752507 wait complete. 2024-01-27T13:32:23.661 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-27T13:32:23.661 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:23.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-27T13:32:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.769+0000 7ffa13afc640 1 Processor -- start 2024-01-27T13:32:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.770+0000 7ffa13afc640 1 -- start start 2024-01-27T13:32:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.770+0000 7ffa13afc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa0c0c2ca0 0x7ffa0c1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.770+0000 7ffa13afc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c77d0 0x7ffa0c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.770+0000 7ffa13afc640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0ccf60 con 0x7ffa0c0c28c0 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.770+0000 7ffa13afc640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c0ca800 con 0x7ffa0c0c2ca0 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.770+0000 7ffa13afc640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1576d0 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.771+0000 7ffa11097640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa0c0c2ca0 0x7ffa0c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.771+0000 7ffa12099640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c77d0 0x7ffa0c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.771+0000 7ffa11097640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa0c0c2ca0 0x7ffa0c1514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:49724/0 (socket says 172.21.15.46:49724) 2024-01-27T13:32:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.771+0000 7ffa11097640 1 -- 172.21.15.46:0/455951061 learned_addr learned my addr 172.21.15.46:0/455951061 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.773+0000 7ffa12099640 1 -- 172.21.15.46:0/455951061 >> v2:172.21.15.78:3300/0 conn(0x7ffa0c0c2ca0 msgr2=0x7ffa0c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.773+0000 7ffa12099640 1 --2- 172.21.15.46:0/455951061 >> v2:172.21.15.78:3300/0 conn(0x7ffa0c0c2ca0 0x7ffa0c1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.773+0000 7ffa12099640 1 -- 172.21.15.46:0/455951061 >> v1:172.21.15.78:6789/0 conn(0x7ffa0c0c28c0 legacy=0x7ffa0c0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.773+0000 7ffa12099640 1 -- 172.21.15.46:0/455951061 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0cd200 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.775+0000 7ffa12099640 1 --2- 172.21.15.46:0/455951061 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c77d0 0x7ffa0c151a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009d90 tx=0x7ffa0402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ee5afaa5752517 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.779+0000 7ffa10896640 1 -- 172.21.15.46:0/455951061 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402cc50 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.779+0000 7ffa10896640 1 -- 172.21.15.46:0/455951061 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0402cdb0 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.779+0000 7ffa10896640 1 -- 172.21.15.46:0/455951061 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa04034660 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.779+0000 7ffa13afc640 1 -- 172.21.15.46:0/455951061 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c77d0 msgr2=0x7ffa0c151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.779+0000 7ffa13afc640 1 --2- 172.21.15.46:0/455951061 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c77d0 0x7ffa0c151a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009d90 tx=0x7ffa0402bea0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.780+0000 7ffa13afc640 1 -- 172.21.15.46:0/455951061 shutdown_connections 2024-01-27T13:32:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.780+0000 7ffa13afc640 1 --2- 172.21.15.46:0/455951061 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c77d0 0x7ffa0c151a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.780+0000 7ffa13afc640 1 --2- 172.21.15.46:0/455951061 >> v2:172.21.15.78:3300/0 conn(0x7ffa0c0c2ca0 0x7ffa0c1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.780+0000 7ffa13afc640 1 -- 172.21.15.46:0/455951061 >> 172.21.15.46:0/455951061 conn(0x7ffa0c06efe0 msgr2=0x7ffa0c06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.780+0000 7ffa13afc640 1 -- 172.21.15.46:0/455951061 shutdown_connections 2024-01-27T13:32:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.780+0000 7ffa13afc640 1 -- 172.21.15.46:0/455951061 wait complete. 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 Processor -- start 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 -- start start 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c28c0 0x7ffa0c14deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa0c0c2ca0 0x7ffa0c14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c0c77d0 0x7ffa0c1eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c14ff10 con 0x7ffa0c0c2ca0 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c14f950 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.781+0000 7ffa13afc640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c14fc30 con 0x7ffa0c0c28c0 2024-01-27T13:32:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.782+0000 7ffa11097640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa0c0c2ca0 0x7ffa0c14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.782+0000 7ffa12099640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c0c77d0 0x7ffa0c1eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.782+0000 7ffa11898640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c28c0 0x7ffa0c14deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.782+0000 7ffa11097640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa0c0c2ca0 0x7ffa0c14f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36508/0 (socket says 172.21.15.46:36508) 2024-01-27T13:32:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.782+0000 7ffa11097640 1 -- 172.21.15.46:0/1661288499 learned_addr learned my addr 172.21.15.46:0/1661288499 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.785+0000 7ffa12099640 1 -- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c28c0 msgr2=0x7ffa0c14deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.785+0000 7ffa12099640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c28c0 0x7ffa0c14deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.785+0000 7ffa12099640 1 -- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa0c0c2ca0 msgr2=0x7ffa0c14f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.785+0000 7ffa12099640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa0c0c2ca0 0x7ffa0c14f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.785+0000 7ffa12099640 1 -- 172.21.15.46:0/1661288499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04009a70 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.788+0000 7ffa12099640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c0c77d0 0x7ffa0c1eee90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0c2620 tx=0x7ffa04004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.791+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0403e610 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.792+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0403e7b0 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.792+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0403eb60 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.792+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0cbf50 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.792+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0cc510 con 0x7ffa0c0c77d0 2024-01-27T13:32:23.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:23.792+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa0c0cbdb0 con 0x7ffa0c0c77d0 2024-01-27T13:32:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.032+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ffa0403b050 con 0x7ffa0c0c77d0 2024-01-27T13:32:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.033+0000 7ffa027fc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff9f006af20 0x7ff9f006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.033+0000 7ffa11898640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff9f006af20 0x7ff9f006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:24.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.033+0000 7ffa11898640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff9f006af20 0x7ff9f006d3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001780 tx=0x7ffa08009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.035+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa0407adb0 con 0x7ffa0c0c77d0 2024-01-27T13:32:24.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.044+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ffa040770f0 con 0x7ffa0c0c77d0 2024-01-27T13:32:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.262+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa0c0cbdb0 con 0x7ffa0c0c77d0 2024-01-27T13:32:24.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.268+0000 7ffa027fc640 1 -- 172.21.15.46:0/1661288499 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffa0c0cbdb0 con 0x7ffa0c0c77d0 2024-01-27T13:32:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff9f006af20 msgr2=0x7ff9f006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff9f006af20 0x7ff9f006d3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001780 tx=0x7ffa08009040 comp rx=0 tx=0).stop 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c0c77d0 msgr2=0x7ffa0c1eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c0c77d0 0x7ffa0c1eee90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0c2620 tx=0x7ffa04004a40 comp rx=0 tx=0).stop 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 shutdown_connections 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff9f006af20 0x7ff9f006d3e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa0c0c77d0 0x7ffa0c1eee90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa0c0c2ca0 0x7ffa0c14f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 --2- 172.21.15.46:0/1661288499 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa0c0c28c0 0x7ffa0c14deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 >> 172.21.15.46:0/1661288499 conn(0x7ffa0c06efe0 msgr2=0x7ffa0c0c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 shutdown_connections 2024-01-27T13:32:24.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:24.270+0000 7ffa13afc640 1 -- 172.21.15.46:0/1661288499 wait complete. 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-27T13:32:24.273 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-27T13:32:24.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-27T13:32:24.274 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-01-27T13:32:24.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.274 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:32:24.289 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42355sec preferred_lft 42355sec 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:32:24.290 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-01-27T13:32:24.291 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-27T13:32:24.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.291 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:32:24.291 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:32:24.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-01-27T13:32:24.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-01-27T13:32:24.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-01-27T13:32:24.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-27T13:32:24.292 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:32:24.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.457 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-27T13:32:24.485 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-01-27T13:32:24.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.487 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-01-27T13:32:24.561 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-01-27T13:32:24.562 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-27T13:32:24.562 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-27T13:32:24.562 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-27T13:32:24.562 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-27T13:32:24.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.562 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:32:24.562 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:32:24.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-27T13:32:24.562 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-27T13:32:24.563 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-27T13:32:24.563 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:32:24.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.865 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T13:32:24.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.880 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-01-27T13:32:24.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:24.934 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:32:24.935 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:32:24.935 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:24.935 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-01-27T13:32:24.935 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:32:25.016 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-01-27T13:32:25.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-01-27T13:32:25.017 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:32:25.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:25.154 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:32:25.154 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:32:25.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-01-27T13:32:25.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-01-27T13:32:25.154 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:32:25.195 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-01-27T13:32:25.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T13:32:25.196 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:25.250 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-01-27T13:32:25.250 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T13:32:25.250 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:25.304 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:32:25.373 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:32:25.428 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:32:25.429 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:32:25.430 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:32:25.431 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:32:25.431 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:25.431 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:25.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:25.431 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:32:25.484 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-27T13:32:25.484 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-01-27T13:32:25.526 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:32:25.553 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:32:25.609 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:32:25.609 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:32:25.609 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:32:25.610 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:25.611 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:25.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:25.612 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:32:25.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:2024-01-27T13:32:25.659+0000 7f9114a47480 -1 init, newargv = 0x5560e1d3e970 newargc=15 2024-01-27T13:32:25.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[42169]: starting ceph client 2024-01-27T13:32:26.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[42169]: starting fuse 2024-01-27T13:32:26.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:32:26.795 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:32:26.851 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:32:26.851 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:32:26.852 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:32:26.853 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:26.854 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:32:26.854 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:26.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:26.854 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:32:26.907 INFO:teuthology.orchestra.run.smithi046.stdout:41 2024-01-27T13:32:26.907 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:32:26.907 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-27T13:32:26.908 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-01-27T13:32:26.909 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-01-27T13:32:26.909 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-01-27T13:32:26.909 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-27T13:32:26.909 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:32:26.909 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.admin")) 2024-01-27T13:32:26.909 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-01-27T13:32:27.027 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.admin.42169.asok 2024-01-27T13:32:27.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-27T13:32:27.037 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42169.asok 2024-01-27T13:32:27.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:27.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42169.asok status 2024-01-27T13:32:27.175 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T13:32:27.175 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-01-27T13:32:27.175 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "99a21c3b6c137f933ecc0074a260e59bd4ba2a7f", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-880-g99a21c3b (99a21c3b6c137f933ecc0074a260e59bd4ba2a7f) squid (dev)", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "admin", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "42169", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4322, 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-01-27T13:32:27.176 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4322 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 4073763558 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 4073763558 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4322 172.21.15.46:0/4073763558", 2024-01-27T13:32:27.177 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "172.21.15.46:0/4073763558", 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 7, 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 25, 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-01-27T13:32:27.178 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T13:32:27.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:27.182 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-01-27T13:32:27.182 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:27.207 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-01-27T13:32:27.208 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:27.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:27.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:27.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:27.347 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-01-27T13:32:27.566 INFO:teuthology.orchestra.run.smithi046.stdout:# file: . 2024-01-27T13:32:27.566 INFO:teuthology.orchestra.run.smithi046.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-01-27T13:32:27.566 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:27.567 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:32:27.567 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T13:32:27.582 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:27.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.730+0000 7fe5cc1d1640 1 Processor -- start 2024-01-27T13:32:27.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.730+0000 7fe5cc1d1640 1 -- start start 2024-01-27T13:32:27.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.731+0000 7fe5cc1d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5c40c28c0 0x7fe5c40c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:27.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.731+0000 7fe5cc1d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5c4151c00 0x7fe5c4157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:27.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.731+0000 7fe5cc1d1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40ccf60 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.731+0000 7fe5cc1d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40ca800 con 0x7fe5c40c28c0 2024-01-27T13:32:27.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.731+0000 7fe5cc1d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c41576d0 con 0x7fe5c4151c00 2024-01-27T13:32:27.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.732+0000 7fe5ca76e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5c4151c00 0x7fe5c4157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:27.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.732+0000 7fe5c9f6d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe5c40c28c0 0x7fe5c40c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:27.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.732+0000 7fe5ca76e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5c4151c00 0x7fe5c4157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:51062/0 (socket says 172.21.15.46:51062) 2024-01-27T13:32:27.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.732+0000 7fe5ca76e640 1 -- 172.21.15.46:0/558356555 learned_addr learned my addr 172.21.15.46:0/558356555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:27.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.735+0000 7fe5c9f6d640 1 -- 172.21.15.46:0/558356555 >> v2:172.21.15.78:3300/0 conn(0x7fe5c4151c00 msgr2=0x7fe5c4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:27.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.735+0000 7fe5c9f6d640 1 --2- 172.21.15.46:0/558356555 >> v2:172.21.15.78:3300/0 conn(0x7fe5c4151c00 0x7fe5c4157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:27.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.735+0000 7fe5c9f6d640 1 -- 172.21.15.46:0/558356555 >> v1:172.21.15.78:6789/0 conn(0x7fe5c40c2ca0 legacy=0x7fe5c41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:27.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.735+0000 7fe5c9f6d640 1 -- 172.21.15.46:0/558356555 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c40cd200 con 0x7fe5c40c28c0 2024-01-27T13:32:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.737+0000 7fe5c9f6d640 1 --2- 172.21.15.46:0/558356555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c28c0 0x7fe5c40c1cd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40c4050 tx=0x7fe5bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651f676acd011441 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.740+0000 7fe5c8f6b640 1 -- 172.21.15.46:0/558356555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc02e070 con 0x7fe5c40c28c0 2024-01-27T13:32:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.740+0000 7fe5c8f6b640 1 -- 172.21.15.46:0/558356555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc0315a0 con 0x7fe5c40c28c0 2024-01-27T13:32:27.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.740+0000 7fe5c8f6b640 1 -- 172.21.15.46:0/558356555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc031930 con 0x7fe5c40c28c0 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/558356555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c28c0 msgr2=0x7fe5c40c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/558356555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c28c0 0x7fe5c40c1cd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40c4050 tx=0x7fe5bc02b840 comp rx=0 tx=0).stop 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/558356555 shutdown_connections 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/558356555 >> v2:172.21.15.78:3300/0 conn(0x7fe5c4151c00 0x7fe5c4157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/558356555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c28c0 0x7fe5c40c1cd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/558356555 >> 172.21.15.46:0/558356555 conn(0x7fe5c406efe0 msgr2=0x7fe5c406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/558356555 shutdown_connections 2024-01-27T13:32:27.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.741+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/558356555 wait complete. 2024-01-27T13:32:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.742+0000 7fe5cc1d1640 1 Processor -- start 2024-01-27T13:32:27.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 -- start start 2024-01-27T13:32:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c40c28c0 0x7fe5c40b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 0x7fe5c41501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c4151c00 0x7fe5c414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:27.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41ed4e0 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41ed7a0 con 0x7fe5c4151c00 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.743+0000 7fe5cc1d1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41eda80 con 0x7fe5c40c28c0 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.744+0000 7fe5c976c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 0x7fe5c41501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.744+0000 7fe5ca76e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c4151c00 0x7fe5c414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.744+0000 7fe5c976c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 0x7fe5c41501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59592/0 (socket says 172.21.15.46:59592) 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.744+0000 7fe5c976c640 1 -- 172.21.15.46:0/2901779841 learned_addr learned my addr 172.21.15.46:0/2901779841 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:27.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.744+0000 7fe5c9f6d640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c40c28c0 0x7fe5c40b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.748+0000 7fe5c976c640 1 -- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c40c28c0 msgr2=0x7fe5c40b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.748+0000 7fe5c976c640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c40c28c0 0x7fe5c40b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.748+0000 7fe5c976c640 1 -- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c4151c00 msgr2=0x7fe5c414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.748+0000 7fe5c976c640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c4151c00 0x7fe5c414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:27.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.748+0000 7fe5c976c640 1 -- 172.21.15.46:0/2901779841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009400 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.750+0000 7fe5c976c640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 0x7fe5c41501f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c3f0 tx=0x7fe5b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.752+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8016070 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.752+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c41edd60 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.752+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c41ee320 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.753+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4074410 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.754+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80067d0 con 0x7fe5c40c2ca0 2024-01-27T13:32:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:27.754+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8003860 con 0x7fe5c40c2ca0 2024-01-27T13:32:28.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.019+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe5b80115f0 con 0x7fe5c40c2ca0 2024-01-27T13:32:28.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.019+0000 7fe5c27fc640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe5b006aed0 0x7fe5b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.019+0000 7fe5c9f6d640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe5b006aed0 0x7fe5b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.020+0000 7fe5c9f6d640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe5b006aed0 0x7fe5b006d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc036000 tx=0x7fe5bc03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:28.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.033+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5b80584e0 con 0x7fe5c40c2ca0 2024-01-27T13:32:28.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.033+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe5b80582b0 con 0x7fe5c40c2ca0 2024-01-27T13:32:28.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.214+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c40c8fa0 con 0x7fe5c40c2ca0 2024-01-27T13:32:28.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.264+0000 7fe5c27fc640 1 -- 172.21.15.46:0/2901779841 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7fe5b8057e40 con 0x7fe5c40c2ca0 2024-01-27T13:32:28.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:28.257 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:28.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe5b006aed0 msgr2=0x7fe5b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe5b006aed0 0x7fe5b006d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc036000 tx=0x7fe5bc03d040 comp rx=0 tx=0).stop 2024-01-27T13:32:28.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 msgr2=0x7fe5c41501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 0x7fe5c41501f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c3f0 tx=0x7fe5b800c8b0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 shutdown_connections 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe5b006aed0 0x7fe5b006d390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5c4151c00 0x7fe5c414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5c40c2ca0 0x7fe5c41501f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 --2- 172.21.15.46:0/2901779841 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe5c40c28c0 0x7fe5c40b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 >> 172.21.15.46:0/2901779841 conn(0x7fe5c406efe0 msgr2=0x7fe5c4155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.266+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 shutdown_connections 2024-01-27T13:32:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.267+0000 7fe5cc1d1640 1 -- 172.21.15.46:0/2901779841 wait complete. 2024-01-27T13:32:28.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T13:32:10.212389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T13:32:11.933652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T13:32:15.934129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T13:32:28.270 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:32:28.316 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:32:28.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:32:28.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.382+0000 7f2fada56640 1 Processor -- start 2024-01-27T13:32:28.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.382+0000 7f2fada56640 1 -- start start 2024-01-27T13:32:28.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.383+0000 7f2fada56640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80c8f00 0x7f2fa80cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.383+0000 7f2fada56640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fa80cf550 0x7f2fa80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.383+0000 7f2fada56640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa80ca9f0 con 0x7f2fa80c92e0 2024-01-27T13:32:28.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.383+0000 7f2fada56640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa80cc9c0 con 0x7f2fa80cf550 2024-01-27T13:32:28.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.383+0000 7f2fada56640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8159d50 con 0x7f2fa80c8f00 2024-01-27T13:32:28.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.384+0000 7f2fa77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fa80cf550 0x7f2fa80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.384+0000 7f2fa6ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80c8f00 0x7f2fa80cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.384+0000 7f2fa77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2fa80cf550 0x7f2fa80cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:51074/0 (socket says 172.21.15.46:51074) 2024-01-27T13:32:28.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.384+0000 7f2fa77fe640 1 -- 172.21.15.46:0/1095958605 learned_addr learned my addr 172.21.15.46:0/1095958605 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.387+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/1095958605 >> v2:172.21.15.78:3300/0 conn(0x7f2fa80cf550 msgr2=0x7f2fa80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.387+0000 7f2fa6ffd640 1 --2- 172.21.15.46:0/1095958605 >> v2:172.21.15.78:3300/0 conn(0x7f2fa80cf550 0x7f2fa80cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.387+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/1095958605 >> v1:172.21.15.78:6789/0 conn(0x7f2fa80c92e0 legacy=0x7f2fa815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.387+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/1095958605 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80cc6e0 con 0x7f2fa80c8f00 2024-01-27T13:32:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.389+0000 7f2fa6ffd640 1 --2- 172.21.15.46:0/1095958605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80c8f00 0x7f2fa80cf010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097a0 tx=0x7f2f9002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f7b5c6919f3c97a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:28.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.392+0000 7f2fa5ffb640 1 -- 172.21.15.46:0/1095958605 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90030610 con 0x7f2fa80c8f00 2024-01-27T13:32:28.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fa5ffb640 1 -- 172.21.15.46:0/1095958605 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90030770 con 0x7f2fa80c8f00 2024-01-27T13:32:28.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fa5ffb640 1 -- 172.21.15.46:0/1095958605 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90030b00 con 0x7f2fa80c8f00 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 -- 172.21.15.46:0/1095958605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80c8f00 msgr2=0x7f2fa80cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 --2- 172.21.15.46:0/1095958605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80c8f00 0x7f2fa80cf010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f900097a0 tx=0x7f2f9002b960 comp rx=0 tx=0).stop 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 -- 172.21.15.46:0/1095958605 shutdown_connections 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 --2- 172.21.15.46:0/1095958605 >> v2:172.21.15.78:3300/0 conn(0x7f2fa80cf550 0x7f2fa80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 --2- 172.21.15.46:0/1095958605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80c8f00 0x7f2fa80cf010 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 -- 172.21.15.46:0/1095958605 >> 172.21.15.46:0/1095958605 conn(0x7f2fa808afd0 msgr2=0x7f2fa808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 -- 172.21.15.46:0/1095958605 shutdown_connections 2024-01-27T13:32:28.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.393+0000 7f2fada56640 1 -- 172.21.15.46:0/1095958605 wait complete. 2024-01-27T13:32:28.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.394+0000 7f2fada56640 1 Processor -- start 2024-01-27T13:32:28.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 -- start start 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 0x7f2fa80ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa80c92e0 0x7f2fa81f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80cf550 0x7f2fa81efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81f2650 con 0x7f2fa80c8f00 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81f35e0 con 0x7f2fa80c92e0 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.395+0000 7f2fada56640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa81f0020 con 0x7f2fa80cf550 2024-01-27T13:32:28.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.396+0000 7f2fa6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 0x7f2fa80ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.396+0000 7f2fa67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa80c92e0 0x7f2fa81f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.396+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80cf550 0x7f2fa81efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.396+0000 7f2fa6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 0x7f2fa80ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59594/0 (socket says 172.21.15.46:59594) 2024-01-27T13:32:28.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.396+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/2336116112 learned_addr learned my addr 172.21.15.46:0/2336116112 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:28.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.400+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/2336116112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80cf550 msgr2=0x7f2fa81efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.400+0000 7f2fa6ffd640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80cf550 0x7f2fa81efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.400+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/2336116112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa80c92e0 msgr2=0x7f2fa81f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.400+0000 7f2fa6ffd640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa80c92e0 0x7f2fa81f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.400+0000 7f2fa6ffd640 1 -- 172.21.15.46:0/2336116112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009400 con 0x7f2fa80c8f00 2024-01-27T13:32:28.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.402+0000 7f2fa6ffd640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 0x7f2fa80ad550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009890 tx=0x7f2f90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:28.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.406+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9003e040 con 0x7f2fa80c8f00 2024-01-27T13:32:28.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.406+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90039ce0 con 0x7f2fa80c8f00 2024-01-27T13:32:28.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.406+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90043680 con 0x7f2fa80c8f00 2024-01-27T13:32:28.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.406+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa8156d20 con 0x7f2fa80c8f00 2024-01-27T13:32:28.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.406+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa81572e0 con 0x7f2fa80c8f00 2024-01-27T13:32:28.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.407+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa8074410 con 0x7f2fa80c8f00 2024-01-27T13:32:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.425+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2f900423e0 con 0x7f2fa80c8f00 2024-01-27T13:32:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.426+0000 7f2f9ffff640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2f8806af20 0x7f2f8806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:28.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.426+0000 7f2fa67fc640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2f8806af20 0x7f2f8806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:28.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.426+0000 7f2fa67fc640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2f8806af20 0x7f2f8806d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2fa815c150 tx=0x7f2f98009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:28.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.684+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f9007a9c0 con 0x7f2fa80c8f00 2024-01-27T13:32:28.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.684+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2f90076d00 con 0x7f2fa80c8f00 2024-01-27T13:32:28.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.861+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fa8157dd0 con 0x7f2fa80c8f00 2024-01-27T13:32:28.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.867+0000 7f2f9ffff640 1 -- 172.21.15.46:0/2336116112 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f90048020 con 0x7f2fa80c8f00 2024-01-27T13:32:28.859 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2f8806af20 msgr2=0x7f2f8806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2f8806af20 0x7f2f8806d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2fa815c150 tx=0x7f2f98009040 comp rx=0 tx=0).stop 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 msgr2=0x7f2fa80ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 0x7f2fa80ad550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009890 tx=0x7f2f90004730 comp rx=0 tx=0).stop 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 shutdown_connections 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2f8806af20 0x7f2f8806d3e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2fa80cf550 0x7f2fa81efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa80c92e0 0x7f2fa81f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 --2- 172.21.15.46:0/2336116112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa80c8f00 0x7f2fa80ad550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:28.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 >> 172.21.15.46:0/2336116112 conn(0x7f2fa808afd0 msgr2=0x7f2fa81586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:28.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 shutdown_connections 2024-01-27T13:32:28.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:28.869+0000 7f2fada56640 1 -- 172.21.15.46:0/2336116112 wait complete. 2024-01-27T13:32:28.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T13:32:29.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.025+0000 7fc8642b4640 1 Processor -- start 2024-01-27T13:32:29.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.025+0000 7fc8642b4640 1 -- start start 2024-01-27T13:32:29.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.026+0000 7fc8642b4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 0x7fc85c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.026+0000 7fc8642b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc85c0c4750 0x7fc85c0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.026+0000 7fc8642b4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c15a280 con 0x7fc85c0c99d0 2024-01-27T13:32:29.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.026+0000 7fc8642b4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c0c6750 con 0x7fc85c0c4750 2024-01-27T13:32:29.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.026+0000 7fc8642b4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0c9e60 con 0x7fc85c153ca0 2024-01-27T13:32:29.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.027+0000 7fc862050640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 0x7fc85c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.027+0000 7fc86184f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc85c0c4750 0x7fc85c0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.027+0000 7fc86184f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc85c0c4750 0x7fc85c0c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:51096/0 (socket says 172.21.15.46:51096) 2024-01-27T13:32:29.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.027+0000 7fc862050640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 0x7fc85c0c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:41132/0 (socket says 172.21.15.46:41132) 2024-01-27T13:32:29.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.027+0000 7fc86184f640 1 -- 172.21.15.46:0/3139012320 learned_addr learned my addr 172.21.15.46:0/3139012320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.030+0000 7fc862050640 1 -- 172.21.15.46:0/3139012320 >> v2:172.21.15.78:3300/0 conn(0x7fc85c0c4750 msgr2=0x7fc85c0c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.030+0000 7fc862050640 1 --2- 172.21.15.46:0/3139012320 >> v2:172.21.15.78:3300/0 conn(0x7fc85c0c4750 0x7fc85c0c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.030+0000 7fc862050640 1 -- 172.21.15.46:0/3139012320 >> v1:172.21.15.78:6789/0 conn(0x7fc85c0c99d0 legacy=0x7fc85c06bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.030+0000 7fc862050640 1 -- 172.21.15.46:0/3139012320 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c15a790 con 0x7fc85c153ca0 2024-01-27T13:32:29.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.032+0000 7fc862050640 1 --2- 172.21.15.46:0/3139012320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 0x7fc85c0c41b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc8540097a0 tx=0x7fc85402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347eb71d04557e87 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:29.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.036+0000 7fc86104e640 1 -- 172.21.15.46:0/3139012320 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854030610 con 0x7fc85c153ca0 2024-01-27T13:32:29.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.036+0000 7fc86104e640 1 -- 172.21.15.46:0/3139012320 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854030770 con 0x7fc85c153ca0 2024-01-27T13:32:29.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.036+0000 7fc86104e640 1 -- 172.21.15.46:0/3139012320 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854030b00 con 0x7fc85c153ca0 2024-01-27T13:32:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.036+0000 7fc8642b4640 1 -- 172.21.15.46:0/3139012320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 msgr2=0x7fc85c0c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.036+0000 7fc8642b4640 1 --2- 172.21.15.46:0/3139012320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 0x7fc85c0c41b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc8540097a0 tx=0x7fc85402b960 comp rx=0 tx=0).stop 2024-01-27T13:32:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.037+0000 7fc8642b4640 1 -- 172.21.15.46:0/3139012320 shutdown_connections 2024-01-27T13:32:29.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.037+0000 7fc8642b4640 1 --2- 172.21.15.46:0/3139012320 >> v2:172.21.15.78:3300/0 conn(0x7fc85c0c4750 0x7fc85c0c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.037+0000 7fc8642b4640 1 --2- 172.21.15.46:0/3139012320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c153ca0 0x7fc85c0c41b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.037+0000 7fc8642b4640 1 -- 172.21.15.46:0/3139012320 >> 172.21.15.46:0/3139012320 conn(0x7fc85c0cf230 msgr2=0x7fc85c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.037+0000 7fc8642b4640 1 -- 172.21.15.46:0/3139012320 shutdown_connections 2024-01-27T13:32:29.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.037+0000 7fc8642b4640 1 -- 172.21.15.46:0/3139012320 wait complete. 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.038+0000 7fc8642b4640 1 Processor -- start 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.038+0000 7fc8642b4640 1 -- start start 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.038+0000 7fc8642b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc85c0c4750 0x7fc85c150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.038+0000 7fc8642b4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c0c99d0 0x7fc85c1f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.038+0000 7fc8642b4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c153ca0 0x7fc85c1f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.038+0000 7fc8642b4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1e4860 con 0x7fc85c153ca0 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc8642b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1f1050 con 0x7fc85c0c4750 2024-01-27T13:32:29.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc8642b4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c159530 con 0x7fc85c0c99d0 2024-01-27T13:32:29.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc862050640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc85c0c4750 0x7fc85c150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc86184f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c0c99d0 0x7fc85c1f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc862851640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c153ca0 0x7fc85c1f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc862851640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c153ca0 0x7fc85c1f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59610/0 (socket says 172.21.15.46:59610) 2024-01-27T13:32:29.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.039+0000 7fc862851640 1 -- 172.21.15.46:0/822349162 learned_addr learned my addr 172.21.15.46:0/822349162 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.043+0000 7fc862050640 1 -- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c0c99d0 msgr2=0x7fc85c1f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.043+0000 7fc862050640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c0c99d0 0x7fc85c1f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.043+0000 7fc862050640 1 -- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c153ca0 msgr2=0x7fc85c1f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.043+0000 7fc862050640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c153ca0 0x7fc85c1f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.043+0000 7fc862050640 1 -- 172.21.15.46:0/822349162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009400 con 0x7fc85c0c4750 2024-01-27T13:32:29.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.045+0000 7fc862050640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc85c0c4750 0x7fc85c150470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc854033000 tx=0x7fc854004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:29.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.049+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85403e040 con 0x7fc85c0c4750 2024-01-27T13:32:29.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.049+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854039cb0 con 0x7fc85c0c4750 2024-01-27T13:32:29.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.049+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c159250 con 0x7fc85c0c4750 2024-01-27T13:32:29.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.049+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854044630 con 0x7fc85c0c4750 2024-01-27T13:32:29.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.049+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c1e3250 con 0x7fc85c0c4750 2024-01-27T13:32:29.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.050+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c074410 con 0x7fc85c0c4750 2024-01-27T13:32:29.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.069+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc85404d3b0 con 0x7fc85c0c4750 2024-01-27T13:32:29.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.069+0000 7fc852ffd640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc84006af20 0x7fc84006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.070+0000 7fc86184f640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc84006af20 0x7fc84006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.070+0000 7fc86184f640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc84006af20 0x7fc84006d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc85c1ed6e0 tx=0x7fc84c009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:29.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.292+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc854039e20 con 0x7fc85c0c4750 2024-01-27T13:32:29.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.302+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc854076ea0 con 0x7fc85c0c4750 2024-01-27T13:32:29.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.484+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc85c0cb480 con 0x7fc85c0c4750 2024-01-27T13:32:29.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.504+0000 7fc852ffd640 1 -- 172.21.15.46:0/822349162 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc85407a4c0 con 0x7fc85c0c4750 2024-01-27T13:32:29.497 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc84006af20 msgr2=0x7fc84006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc84006af20 0x7fc84006d3e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc85c1ed6e0 tx=0x7fc84c009240 comp rx=0 tx=0).stop 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc85c0c4750 msgr2=0x7fc85c150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc85c0c4750 0x7fc85c150470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc854033000 tx=0x7fc854004730 comp rx=0 tx=0).stop 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 shutdown_connections 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc84006af20 0x7fc84006d3e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc85c153ca0 0x7fc85c1f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc85c0c99d0 0x7fc85c1f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 --2- 172.21.15.46:0/822349162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc85c0c4750 0x7fc85c150470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 >> 172.21.15.46:0/822349162 conn(0x7fc85c0cf230 msgr2=0x7fc85c149d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 shutdown_connections 2024-01-27T13:32:29.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.506+0000 7fc8642b4640 1 -- 172.21.15.46:0/822349162 wait complete. 2024-01-27T13:32:29.510 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T13:32:29.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.633+0000 7f1c4043d640 1 Processor -- start 2024-01-27T13:32:29.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.633+0000 7f1c4043d640 1 -- start start 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.634+0000 7f1c4043d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c380c28c0 0x7f1c380c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.634+0000 7f1c4043d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1c38151c00 0x7f1c38157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.634+0000 7f1c4043d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c380ccf60 con 0x7f1c380c2ca0 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.634+0000 7f1c4043d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c380ca800 con 0x7f1c38151c00 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.634+0000 7f1c4043d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381576d0 con 0x7f1c380c28c0 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.635+0000 7f1c3d9d8640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1c380c2ca0 0x7f1c381514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60034/0 (socket says 172.21.15.46:60034) 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.635+0000 7f1c3d9d8640 1 -- 172.21.15.46:0/2499801774 learned_addr learned my addr 172.21.15.46:0/2499801774 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:29.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.635+0000 7f1c3e1d9640 1 --2- 172.21.15.46:0/2499801774 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c380c28c0 0x7f1c380c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.635+0000 7f1c3e9da640 1 --2- 172.21.15.46:0/2499801774 >> v2:172.21.15.78:3300/0 conn(0x7f1c38151c00 0x7f1c38157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.637+0000 7f1c3e1d9640 1 -- 172.21.15.46:0/2499801774 >> v2:172.21.15.78:3300/0 conn(0x7f1c38151c00 msgr2=0x7f1c38157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:29.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.637+0000 7f1c3e1d9640 1 --2- 172.21.15.46:0/2499801774 >> v2:172.21.15.78:3300/0 conn(0x7f1c38151c00 0x7f1c38157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.637+0000 7f1c3e1d9640 1 -- 172.21.15.46:0/2499801774 >> v1:172.21.15.46:6789/0 conn(0x7f1c380c2ca0 legacy=0x7f1c381514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.637+0000 7f1c3e1d9640 1 -- 172.21.15.46:0/2499801774 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c380cd200 con 0x7f1c380c28c0 2024-01-27T13:32:29.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.637+0000 7f1c3e9da640 1 --2- 172.21.15.46:0/2499801774 >> v2:172.21.15.78:3300/0 conn(0x7f1c38151c00 0x7f1c38157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:29.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.640+0000 7f1c3e1d9640 1 --2- 172.21.15.46:0/2499801774 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c380c28c0 0x7f1c380c1cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009d90 tx=0x7f1c2802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce43a2493b9ba82a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.643+0000 7f1c3d1d7640 1 -- 172.21.15.46:0/2499801774 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2802cc50 con 0x7f1c380c28c0 2024-01-27T13:32:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.643+0000 7f1c3d1d7640 1 -- 172.21.15.46:0/2499801774 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2802cdb0 con 0x7f1c380c28c0 2024-01-27T13:32:29.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.643+0000 7f1c3d1d7640 1 -- 172.21.15.46:0/2499801774 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c28034660 con 0x7f1c380c28c0 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 -- 172.21.15.46:0/2499801774 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c380c28c0 msgr2=0x7f1c380c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 --2- 172.21.15.46:0/2499801774 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c380c28c0 0x7f1c380c1cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009d90 tx=0x7f1c2802bea0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 -- 172.21.15.46:0/2499801774 shutdown_connections 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 --2- 172.21.15.46:0/2499801774 >> v2:172.21.15.78:3300/0 conn(0x7f1c38151c00 0x7f1c38157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 --2- 172.21.15.46:0/2499801774 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c380c28c0 0x7f1c380c1cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 -- 172.21.15.46:0/2499801774 >> 172.21.15.46:0/2499801774 conn(0x7f1c3806efe0 msgr2=0x7f1c3806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 -- 172.21.15.46:0/2499801774 shutdown_connections 2024-01-27T13:32:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.644+0000 7f1c4043d640 1 -- 172.21.15.46:0/2499801774 wait complete. 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.645+0000 7f1c4043d640 1 Processor -- start 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.645+0000 7f1c4043d640 1 -- start start 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c4043d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c380c28c0 0x7f1c381ef220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c4043d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c380c2ca0 0x7f1c381f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c4043d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 0x7f1c3814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c4043d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381f2790 con 0x7f1c380c28c0 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c4043d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381f2d50 con 0x7f1c380c2ca0 2024-01-27T13:32:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c4043d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c381e2ef0 con 0x7f1c38151c00 2024-01-27T13:32:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c3d9d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c380c2ca0 0x7f1c381f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.646+0000 7f1c3e9da640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 0x7f1c3814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.647+0000 7f1c3e9da640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 0x7f1c3814e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:41168/0 (socket says 172.21.15.46:41168) 2024-01-27T13:32:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.647+0000 7f1c3e9da640 1 -- 172.21.15.46:0/3436338207 learned_addr learned my addr 172.21.15.46:0/3436338207 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:29.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.651+0000 7f1c3e9da640 1 -- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c380c2ca0 msgr2=0x7f1c381f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.651+0000 7f1c3e9da640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c380c2ca0 0x7f1c381f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.651+0000 7f1c3e9da640 1 -- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c380c28c0 msgr2=0x7f1c381ef220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:29.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.651+0000 7f1c3e9da640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c380c28c0 0x7f1c381ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:29.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.651+0000 7f1c3e9da640 1 -- 172.21.15.46:0/3436338207 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30009400 con 0x7f1c38151c00 2024-01-27T13:32:29.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.654+0000 7f1c3e9da640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 0x7f1c3814e200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e8f0 tx=0x7f1c3000edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:29.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.658+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30004020 con 0x7f1c38151c00 2024-01-27T13:32:29.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.658+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300041a0 con 0x7f1c38151c00 2024-01-27T13:32:29.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.658+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c28009a70 con 0x7f1c38151c00 2024-01-27T13:32:29.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.658+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000c940 con 0x7f1c38151c00 2024-01-27T13:32:29.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.658+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c381e3470 con 0x7f1c38151c00 2024-01-27T13:32:29.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.659+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c38074410 con 0x7f1c38151c00 2024-01-27T13:32:29.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.902+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1c3000caa0 con 0x7f1c38151c00 2024-01-27T13:32:29.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.903+0000 7f1c36ffd640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1c2406af20 0x7f1c2406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:29.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.903+0000 7f1c3e1d9640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1c2406af20 0x7f1c2406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:29.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.903+0000 7f1c3e1d9640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1c2406af20 0x7f1c2406d3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c28036000 tx=0x7f1c2802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:29.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.905+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c300588a0 con 0x7f1c38151c00 2024-01-27T13:32:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:29.915+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1c30054be0 con 0x7f1c38151c00 2024-01-27T13:32:30.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.096+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c381f2e90 con 0x7f1c38151c00 2024-01-27T13:32:30.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.102+0000 7f1c36ffd640 1 -- 172.21.15.46:0/3436338207 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c300170a0 con 0x7f1c38151c00 2024-01-27T13:32:30.095 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1c2406af20 msgr2=0x7f1c2406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1c2406af20 0x7f1c2406d3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c28036000 tx=0x7f1c2802e000 comp rx=0 tx=0).stop 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 msgr2=0x7f1c3814e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 0x7f1c3814e200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e8f0 tx=0x7f1c3000edb0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 shutdown_connections 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1c2406af20 0x7f1c2406d3e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1c38151c00 0x7f1c3814e200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c380c2ca0 0x7f1c381f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 --2- 172.21.15.46:0/3436338207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c380c28c0 0x7f1c381ef220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 >> 172.21.15.46:0/3436338207 conn(0x7f1c3806efe0 msgr2=0x7f1c380663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 shutdown_connections 2024-01-27T13:32:30.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.104+0000 7f1c4043d640 1 -- 172.21.15.46:0/3436338207 wait complete. 2024-01-27T13:32:30.108 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T13:32:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.221+0000 7f8c4f0ec640 1 Processor -- start 2024-01-27T13:32:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.221+0000 7f8c4f0ec640 1 -- start start 2024-01-27T13:32:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.222+0000 7f8c4f0ec640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c4806ffc0 0x7f8c4815b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.222+0000 7f8c4f0ec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c480663a0 0x7f8c4815b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.222+0000 7f8c4f0ec640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c48158530 con 0x7f8c48151830 2024-01-27T13:32:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.222+0000 7f8c4f0ec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4815abc0 con 0x7f8c480663a0 2024-01-27T13:32:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.222+0000 7f8c4f0ec640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c48157fb0 con 0x7f8c4806ffc0 2024-01-27T13:32:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.223+0000 7f8c4d689640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8c480663a0 0x7f8c4815b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.223+0000 7f8c47fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c4806ffc0 0x7f8c4815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.223+0000 7f8c4ce88640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f8c48151830 0x7f8c480c4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60042/0 (socket says 172.21.15.46:60042) 2024-01-27T13:32:30.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.223+0000 7f8c4ce88640 1 -- 172.21.15.46:0/1220637590 learned_addr learned my addr 172.21.15.46:0/1220637590 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.225+0000 7f8c47fff640 1 -- 172.21.15.46:0/1220637590 >> v2:172.21.15.46:3300/0 conn(0x7f8c480663a0 msgr2=0x7f8c4815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.225+0000 7f8c47fff640 1 --2- 172.21.15.46:0/1220637590 >> v2:172.21.15.46:3300/0 conn(0x7f8c480663a0 0x7f8c4815b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.225+0000 7f8c47fff640 1 -- 172.21.15.46:0/1220637590 >> v1:172.21.15.46:6789/0 conn(0x7f8c48151830 legacy=0x7f8c480c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.225+0000 7f8c47fff640 1 -- 172.21.15.46:0/1220637590 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c48158250 con 0x7f8c4806ffc0 2024-01-27T13:32:30.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.227+0000 7f8c47fff640 1 --2- 172.21.15.46:0/1220637590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c4806ffc0 0x7f8c4815b050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0097a0 tx=0x7f8c3c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bb5c9e668e2bed server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:30.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c477fe640 1 -- 172.21.15.46:0/1220637590 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c031830 con 0x7f8c4806ffc0 2024-01-27T13:32:30.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c477fe640 1 -- 172.21.15.46:0/1220637590 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c031990 con 0x7f8c4806ffc0 2024-01-27T13:32:30.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c477fe640 1 -- 172.21.15.46:0/1220637590 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c031d20 con 0x7f8c4806ffc0 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1220637590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c4806ffc0 msgr2=0x7f8c4815b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1220637590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c4806ffc0 0x7f8c4815b050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0097a0 tx=0x7f8c3c02b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1220637590 shutdown_connections 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1220637590 >> v2:172.21.15.46:3300/0 conn(0x7f8c480663a0 0x7f8c4815b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1220637590 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c4806ffc0 0x7f8c4815b050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.231+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1220637590 >> 172.21.15.46:0/1220637590 conn(0x7f8c48071980 msgr2=0x7f8c48071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.232+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1220637590 shutdown_connections 2024-01-27T13:32:30.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.232+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1220637590 wait complete. 2024-01-27T13:32:30.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.233+0000 7f8c4f0ec640 1 Processor -- start 2024-01-27T13:32:30.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.233+0000 7f8c4f0ec640 1 -- start start 2024-01-27T13:32:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4f0ec640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c480663a0 0x7f8c48141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4f0ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 0x7f8c48146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4f0ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48151830 0x7f8c481ed510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4f0ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4814ced0 con 0x7f8c4806ffc0 2024-01-27T13:32:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4f0ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4814bc20 con 0x7f8c48151830 2024-01-27T13:32:30.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4f0ec640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4814de90 con 0x7f8c480663a0 2024-01-27T13:32:30.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c47fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 0x7f8c48146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4ce88640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c480663a0 0x7f8c48141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c4d689640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48151830 0x7f8c481ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c47fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 0x7f8c48146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59626/0 (socket says 172.21.15.46:59626) 2024-01-27T13:32:30.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.234+0000 7f8c47fff640 1 -- 172.21.15.46:0/1545573077 learned_addr learned my addr 172.21.15.46:0/1545573077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.238+0000 7f8c47fff640 1 -- 172.21.15.46:0/1545573077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c480663a0 msgr2=0x7f8c48141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.238+0000 7f8c47fff640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c480663a0 0x7f8c48141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.238+0000 7f8c47fff640 1 -- 172.21.15.46:0/1545573077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48151830 msgr2=0x7f8c481ed510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.238+0000 7f8c47fff640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48151830 0x7f8c481ed510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.238+0000 7f8c47fff640 1 -- 172.21.15.46:0/1545573077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c009400 con 0x7f8c4806ffc0 2024-01-27T13:32:30.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.240+0000 7f8c47fff640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 0x7f8c48146870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c034040 tx=0x7f8c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:30.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.244+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c03a8f0 con 0x7f8c4806ffc0 2024-01-27T13:32:30.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.244+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c03aa70 con 0x7f8c4806ffc0 2024-01-27T13:32:30.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.244+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c03ae20 con 0x7f8c4806ffc0 2024-01-27T13:32:30.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.244+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4814e320 con 0x7f8c4806ffc0 2024-01-27T13:32:30.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.244+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4814c910 con 0x7f8c4806ffc0 2024-01-27T13:32:30.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.245+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c48074410 con 0x7f8c4806ffc0 2024-01-27T13:32:30.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.509+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8c3c04d440 con 0x7f8c4806ffc0 2024-01-27T13:32:30.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.509+0000 7f8c457fa640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8c3406af20 0x7f8c3406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.509+0000 7f8c4ce88640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8c3406af20 0x7f8c3406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.510+0000 7f8c4ce88640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8c3406af20 0x7f8c3406d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c400012e0 tx=0x7f8c40001990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:30.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.526+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c3c07a9c0 con 0x7f8c4806ffc0 2024-01-27T13:32:30.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.526+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8c3c076d00 con 0x7f8c4806ffc0 2024-01-27T13:32:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.717+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8c48144e40 con 0x7f8c4806ffc0 2024-01-27T13:32:30.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.723+0000 7f8c457fa640 1 -- 172.21.15.46:0/1545573077 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8c3c035020 con 0x7f8c4806ffc0 2024-01-27T13:32:30.715 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:32:30.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8c3406af20 msgr2=0x7f8c3406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8c3406af20 0x7f8c3406d3e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c400012e0 tx=0x7f8c40001990 comp rx=0 tx=0).stop 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 msgr2=0x7f8c48146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 0x7f8c48146870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c034040 tx=0x7f8c3c0046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 shutdown_connections 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8c3406af20 0x7f8c3406d3e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48151830 0x7f8c481ed510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c4806ffc0 0x7f8c48146870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 --2- 172.21.15.46:0/1545573077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8c480663a0 0x7f8c48141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 >> 172.21.15.46:0/1545573077 conn(0x7f8c48071980 msgr2=0x7f8c480c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 shutdown_connections 2024-01-27T13:32:30.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.725+0000 7f8c4f0ec640 1 -- 172.21.15.46:0/1545573077 wait complete. 2024-01-27T13:32:30.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T13:32:30.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.840+0000 7f0800790640 1 Processor -- start 2024-01-27T13:32:30.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.840+0000 7f0800790640 1 -- start start 2024-01-27T13:32:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.841+0000 7f0800790640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07f80cb1e0 0x7f07f815a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.841+0000 7f0800790640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f815a8a0 con 0x7f07f8153db0 2024-01-27T13:32:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.841+0000 7f0800790640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f80c99d0 con 0x7f07f80c7690 2024-01-27T13:32:30.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.841+0000 7f0800790640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f80cab10 con 0x7f07f80cb1e0 2024-01-27T13:32:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.842+0000 7f07fdd2b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f07f80cb1e0 0x7f07f815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.842+0000 7f07fed2d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07f80c7690 0x7f07f8164180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:38754/0 (socket says 172.21.15.46:38754) 2024-01-27T13:32:30.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.842+0000 7f07fed2d640 1 -- 172.21.15.46:0/2845682424 learned_addr learned my addr 172.21.15.46:0/2845682424 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:30.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.844+0000 7f07fd52a640 1 -- 172.21.15.46:0/2845682424 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888911983 0 0) 0x7f07f80c99d0 con 0x7f07f80c7690 2024-01-27T13:32:30.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.844+0000 7f07fd52a640 1 -- 172.21.15.46:0/2845682424 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4003520 con 0x7f07f80c7690 2024-01-27T13:32:30.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.846+0000 7f07fdd2b640 1 -- 172.21.15.46:0/2845682424 >> v1:172.21.15.78:6789/0 conn(0x7f07f80c7690 legacy=0x7f07f8164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.846+0000 7f07fdd2b640 1 -- 172.21.15.46:0/2845682424 >> v1:172.21.15.46:6789/0 conn(0x7f07f8153db0 legacy=0x7f07f806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.846+0000 7f07fdd2b640 1 -- 172.21.15.46:0/2845682424 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80c9c20 con 0x7f07f80cb1e0 2024-01-27T13:32:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.850+0000 7f07fdd2b640 1 --2- 172.21.15.46:0/2845682424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f80cb1e0 0x7f07f815a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07e80097a0 tx=0x7f07e802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1794a417e2f0c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:30.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.854+0000 7f07fd52a640 1 -- 172.21.15.46:0/2845682424 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8030610 con 0x7f07f80cb1e0 2024-01-27T13:32:30.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.854+0000 7f07fd52a640 1 -- 172.21.15.46:0/2845682424 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e8030770 con 0x7f07f80cb1e0 2024-01-27T13:32:30.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.854+0000 7f07fd52a640 1 -- 172.21.15.46:0/2845682424 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e8030b00 con 0x7f07f80cb1e0 2024-01-27T13:32:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.854+0000 7f0800790640 1 -- 172.21.15.46:0/2845682424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f80cb1e0 msgr2=0x7f07f815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.854+0000 7f0800790640 1 --2- 172.21.15.46:0/2845682424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f80cb1e0 0x7f07f815a360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07e80097a0 tx=0x7f07e802b960 comp rx=0 tx=0).stop 2024-01-27T13:32:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.855+0000 7f0800790640 1 -- 172.21.15.46:0/2845682424 shutdown_connections 2024-01-27T13:32:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.855+0000 7f0800790640 1 --2- 172.21.15.46:0/2845682424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f80cb1e0 0x7f07f815a360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.855+0000 7f0800790640 1 -- 172.21.15.46:0/2845682424 >> 172.21.15.46:0/2845682424 conn(0x7f07f80cf050 msgr2=0x7f07f80cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.855+0000 7f0800790640 1 -- 172.21.15.46:0/2845682424 shutdown_connections 2024-01-27T13:32:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.855+0000 7f0800790640 1 -- 172.21.15.46:0/2845682424 wait complete. 2024-01-27T13:32:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 Processor -- start 2024-01-27T13:32:30.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 -- start start 2024-01-27T13:32:30.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c7690 0x7f07f81f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f80cb1e0 0x7f07f81ef100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f8153db0 0x7f07f815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f81f2d60 con 0x7f07f8153db0 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f814e6e0 con 0x7f07f80c7690 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.856+0000 7f0800790640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f814e9c0 con 0x7f07f80cb1e0 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.857+0000 7f07fed2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f8153db0 0x7f07f815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.857+0000 7f07fed2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f8153db0 0x7f07f815cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59652/0 (socket says 172.21.15.46:59652) 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.857+0000 7f07fed2d640 1 -- 172.21.15.46:0/1278475687 learned_addr learned my addr 172.21.15.46:0/1278475687 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.857+0000 7f07fe52c640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c7690 0x7f07f81f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.857+0000 7f07fdd2b640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f80cb1e0 0x7f07f81ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:30.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.861+0000 7f07fe52c640 1 -- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f80cb1e0 msgr2=0x7f07f81ef100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.861+0000 7f07fe52c640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f80cb1e0 0x7f07f81ef100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.861+0000 7f07fe52c640 1 -- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f8153db0 msgr2=0x7f07f815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:30.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.861+0000 7f07fe52c640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f8153db0 0x7f07f815cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:30.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.861+0000 7f07fe52c640 1 -- 172.21.15.46:0/1278475687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009400 con 0x7f07f80c7690 2024-01-27T13:32:30.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.863+0000 7f07fe52c640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c7690 0x7f07f81f31f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c3c0 tx=0x7f07f400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:30.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.866+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40052d0 con 0x7f07f80c7690 2024-01-27T13:32:30.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.866+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4005450 con 0x7f07f80c7690 2024-01-27T13:32:30.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.866+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4007260 con 0x7f07f80c7690 2024-01-27T13:32:30.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.867+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f81f2710 con 0x7f07f80c7690 2024-01-27T13:32:30.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.867+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f815c040 con 0x7f07f80c7690 2024-01-27T13:32:30.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:30.867+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f80c6f60 con 0x7f07f80c7690 2024-01-27T13:32:31.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.103+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f07f40073c0 con 0x7f07f80c7690 2024-01-27T13:32:31.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.104+0000 7f07eeffd640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f07dc06af50 0x7f07dc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.104+0000 7f07fdd2b640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f07dc06af50 0x7f07dc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.104+0000 7f07fdd2b640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f07dc06af50 0x7f07dc06d410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07e8036000 tx=0x7f07e8008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:31.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.108+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07f4057ed0 con 0x7f07f80c7690 2024-01-27T13:32:31.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.121+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f07f4054210 con 0x7f07f80c7690 2024-01-27T13:32:31.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.313+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07f815a8a0 con 0x7f07f80c7690 2024-01-27T13:32:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.318+0000 7f07eeffd640 1 -- 172.21.15.46:0/1278475687 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f07f815a8a0 con 0x7f07f80c7690 2024-01-27T13:32:31.310 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f07dc06af50 msgr2=0x7f07dc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f07dc06af50 0x7f07dc06d410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07e8036000 tx=0x7f07e8008030 comp rx=0 tx=0).stop 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c7690 msgr2=0x7f07f81f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c7690 0x7f07f81f31f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c3c0 tx=0x7f07f400c880 comp rx=0 tx=0).stop 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 shutdown_connections 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f07dc06af50 0x7f07dc06d410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07f8153db0 0x7f07f815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f07f80cb1e0 0x7f07f81ef100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 --2- 172.21.15.46:0/1278475687 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f80c7690 0x7f07f81f31f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 >> 172.21.15.46:0/1278475687 conn(0x7f07f80cf050 msgr2=0x7f07f80c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 shutdown_connections 2024-01-27T13:32:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.320+0000 7f0800790640 1 -- 172.21.15.46:0/1278475687 wait complete. 2024-01-27T13:32:31.323 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:32:31.324 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T13:32:31.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.489+0000 7f8924343640 1 Processor -- start 2024-01-27T13:32:31.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.489+0000 7f8924343640 1 -- start start 2024-01-27T13:32:31.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f8924343640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f891c0c4f80 0x7f891c153760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f8924343640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c9d70 0x7f891c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f8924343640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c06bcd0 con 0x7f891c0c4ba0 2024-01-27T13:32:31.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f8924343640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c06cd00 con 0x7f891c0c4f80 2024-01-27T13:32:31.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f8924343640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c06bf40 con 0x7f891c0c9d70 2024-01-27T13:32:31.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f89228e0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c9d70 0x7f891c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.490+0000 7f89218de640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f891c0c4f80 0x7f891c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.491+0000 7f89220df640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f891c0c4ba0 0x7f891c0b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60056/0 (socket says 172.21.15.46:60056) 2024-01-27T13:32:31.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.491+0000 7f89220df640 1 -- 172.21.15.46:0/3967401676 learned_addr learned my addr 172.21.15.46:0/3967401676 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.493+0000 7f89228e0640 1 -- 172.21.15.46:0/3967401676 >> v2:172.21.15.46:3300/0 conn(0x7f891c0c4f80 msgr2=0x7f891c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.493+0000 7f89228e0640 1 --2- 172.21.15.46:0/3967401676 >> v2:172.21.15.46:3300/0 conn(0x7f891c0c4f80 0x7f891c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.493+0000 7f89228e0640 1 -- 172.21.15.46:0/3967401676 >> v1:172.21.15.46:6789/0 conn(0x7f891c0c4ba0 legacy=0x7f891c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.493+0000 7f89228e0640 1 -- 172.21.15.46:0/3967401676 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c06c220 con 0x7f891c0c9d70 2024-01-27T13:32:31.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.495+0000 7f89228e0640 1 --2- 172.21.15.46:0/3967401676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c9d70 0x7f891c153ca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8914009d90 tx=0x7f891402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bddf1de20ef313e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.498+0000 7f89210dd640 1 -- 172.21.15.46:0/3967401676 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891402cce0 con 0x7f891c0c9d70 2024-01-27T13:32:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.498+0000 7f89210dd640 1 -- 172.21.15.46:0/3967401676 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891402ce40 con 0x7f891c0c9d70 2024-01-27T13:32:31.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.498+0000 7f89210dd640 1 -- 172.21.15.46:0/3967401676 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914034660 con 0x7f891c0c9d70 2024-01-27T13:32:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 -- 172.21.15.46:0/3967401676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c9d70 msgr2=0x7f891c153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 --2- 172.21.15.46:0/3967401676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c9d70 0x7f891c153ca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8914009d90 tx=0x7f891402bf30 comp rx=0 tx=0).stop 2024-01-27T13:32:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 -- 172.21.15.46:0/3967401676 shutdown_connections 2024-01-27T13:32:31.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 --2- 172.21.15.46:0/3967401676 >> v2:172.21.15.46:3300/0 conn(0x7f891c0c4f80 0x7f891c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 --2- 172.21.15.46:0/3967401676 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c9d70 0x7f891c153ca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 -- 172.21.15.46:0/3967401676 >> 172.21.15.46:0/3967401676 conn(0x7f891c08b6b0 msgr2=0x7f891c0663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 -- 172.21.15.46:0/3967401676 shutdown_connections 2024-01-27T13:32:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.499+0000 7f8924343640 1 -- 172.21.15.46:0/3967401676 wait complete. 2024-01-27T13:32:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.500+0000 7f8924343640 1 Processor -- start 2024-01-27T13:32:31.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.500+0000 7f8924343640 1 -- start start 2024-01-27T13:32:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f8924343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f891c0c4ba0 0x7f891c0cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f8924343640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c4f80 0x7f891c0cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f8924343640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 0x7f891c0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f8924343640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0ce120 con 0x7f891c0c9d70 2024-01-27T13:32:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f8924343640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c1efa20 con 0x7f891c0c4ba0 2024-01-27T13:32:31.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f8924343640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c15d1d0 con 0x7f891c0c4f80 2024-01-27T13:32:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.501+0000 7f89228e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 0x7f891c0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.502+0000 7f89228e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 0x7f891c0cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59682/0 (socket says 172.21.15.46:59682) 2024-01-27T13:32:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.502+0000 7f89228e0640 1 -- 172.21.15.46:0/820032895 learned_addr learned my addr 172.21.15.46:0/820032895 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.502+0000 7f89220df640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f891c0c4ba0 0x7f891c0cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.502+0000 7f89218de640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c4f80 0x7f891c0cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.505+0000 7f89228e0640 1 -- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c4f80 msgr2=0x7f891c0cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.505+0000 7f89228e0640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c4f80 0x7f891c0cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.505+0000 7f89228e0640 1 -- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f891c0c4ba0 msgr2=0x7f891c0cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:31.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.505+0000 7f89228e0640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f891c0c4ba0 0x7f891c0cdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:31.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.505+0000 7f89228e0640 1 -- 172.21.15.46:0/820032895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8914009a70 con 0x7f891c0c9d70 2024-01-27T13:32:31.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.507+0000 7f89228e0640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 0x7f891c0cbad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8914009d90 tx=0x7f8914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.511+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891403e610 con 0x7f891c0c9d70 2024-01-27T13:32:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.511+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891403e770 con 0x7f891c0c9d70 2024-01-27T13:32:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.511+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891403eb00 con 0x7f891c0c9d70 2024-01-27T13:32:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.511+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c1eff10 con 0x7f891c0c9d70 2024-01-27T13:32:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.511+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c0cc860 con 0x7f891c0c9d70 2024-01-27T13:32:31.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.512+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c074410 con 0x7f891c0c9d70 2024-01-27T13:32:31.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.532+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f891403b050 con 0x7f891c0c9d70 2024-01-27T13:32:31.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.532+0000 7f8912ffd640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f890006af20 0x7f890006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:31.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.532+0000 7f89220df640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f890006af20 0x7f890006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:31.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.533+0000 7f89220df640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f890006af20 0x7f890006d3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8918007fd0 tx=0x7f8918007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.791+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f891407ab70 con 0x7f891c0c9d70 2024-01-27T13:32:31.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.791+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8914076eb0 con 0x7f891c0c9d70 2024-01-27T13:32:31.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:31.981+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f891c066720 con 0x7f891c0c9d70 2024-01-27T13:32:32.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.021+0000 7f8912ffd640 1 -- 172.21.15.46:0/820032895 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f891404e090 con 0x7f891c0c9d70 2024-01-27T13:32:32.014 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:32.014 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f890006af20 msgr2=0x7f890006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f890006af20 0x7f890006d3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8918007fd0 tx=0x7f8918007e80 comp rx=0 tx=0).stop 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 msgr2=0x7f891c0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 0x7f891c0cbad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8914009d90 tx=0x7f8914004a40 comp rx=0 tx=0).stop 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 shutdown_connections 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f890006af20 0x7f890006d3e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f891c0c9d70 0x7f891c0cbad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f891c0c4f80 0x7f891c0cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 --2- 172.21.15.46:0/820032895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f891c0c4ba0 0x7f891c0cdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 >> 172.21.15.46:0/820032895 conn(0x7f891c08b6b0 msgr2=0x7f891c14ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 shutdown_connections 2024-01-27T13:32:32.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.024+0000 7f8924343640 1 -- 172.21.15.46:0/820032895 wait complete. 2024-01-27T13:32:32.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T13:32:10.212389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T13:32:11.933652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T13:32:15.934129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T13:32:32.030 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:32:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.142+0000 7fbcdd597640 1 Processor -- start 2024-01-27T13:32:32.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.142+0000 7fbcdd597640 1 -- start start 2024-01-27T13:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.142+0000 7fbcdd597640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd80cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.142+0000 7fbcdd597640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd80ca9f0 con 0x7fbcd80cf550 2024-01-27T13:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.142+0000 7fbcdd597640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd8159d50 con 0x7fbcd80c92e0 2024-01-27T13:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.142+0000 7fbcdd597640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80cc9c0 con 0x7fbcd80c8f00 2024-01-27T13:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.143+0000 7fbcd77fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbcd80cf550 0x7fbcd80cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2024-01-27T13:32:32.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.143+0000 7fbcd77fe640 1 -- 172.21.15.46:0/4046650954 learned_addr learned my addr 172.21.15.46:0/4046650954 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:32.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.143+0000 7fbcd6ffd640 1 --2- 172.21.15.46:0/4046650954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd80cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.145+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047312640 0 0) 0x7fbcd80ca9f0 con 0x7fbcd80cf550 2024-01-27T13:32:32.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.146+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcc4003520 con 0x7fbcd80cf550 2024-01-27T13:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.146+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224834297 0 0) 0x7fbcd8159d50 con 0x7fbcd80c92e0 2024-01-27T13:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.146+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd80ca9f0 con 0x7fbcd80c92e0 2024-01-27T13:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.146+0000 7fbcd6ffd640 1 -- 172.21.15.46:0/4046650954 >> v1:172.21.15.78:6789/0 conn(0x7fbcd80c92e0 legacy=0x7fbcd815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.146+0000 7fbcd6ffd640 1 -- 172.21.15.46:0/4046650954 >> v1:172.21.15.46:6789/0 conn(0x7fbcd80cf550 legacy=0x7fbcd80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.146+0000 7fbcd6ffd640 1 -- 172.21.15.46:0/4046650954 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80cc6e0 con 0x7fbcd80c8f00 2024-01-27T13:32:32.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.148+0000 7fbcd6ffd640 1 --2- 172.21.15.46:0/4046650954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd80cf010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00097d0 tx=0x7fbcd002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd542484091a94e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0030880 con 0x7fbcd80c8f00 2024-01-27T13:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd00309e0 con 0x7fbcd80c8f00 2024-01-27T13:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcd5ffb640 1 -- 172.21.15.46:0/4046650954 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0030d70 con 0x7fbcd80c8f00 2024-01-27T13:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 -- 172.21.15.46:0/4046650954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 msgr2=0x7fbcd80cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 --2- 172.21.15.46:0/4046650954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd80cf010 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00097d0 tx=0x7fbcd002b9c0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 -- 172.21.15.46:0/4046650954 shutdown_connections 2024-01-27T13:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 --2- 172.21.15.46:0/4046650954 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd80cf010 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 -- 172.21.15.46:0/4046650954 >> 172.21.15.46:0/4046650954 conn(0x7fbcd808afd0 msgr2=0x7fbcd808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 -- 172.21.15.46:0/4046650954 shutdown_connections 2024-01-27T13:32:32.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.152+0000 7fbcdd597640 1 -- 172.21.15.46:0/4046650954 wait complete. 2024-01-27T13:32:32.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 Processor -- start 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 -- start start 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd8150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd80c92e0 0x7fbcd80ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 0x7fbcd80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81518d0 con 0x7fbcd80cf550 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd80aa9e0 con 0x7fbcd80c92e0 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.154+0000 7fbcdd597640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd81f2820 con 0x7fbcd80c8f00 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.155+0000 7fbcd77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 0x7fbcd80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.155+0000 7fbcd67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd80c92e0 0x7fbcd80ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.155+0000 7fbcd77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 0x7fbcd80cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59694/0 (socket says 172.21.15.46:59694) 2024-01-27T13:32:32.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.155+0000 7fbcd77fe640 1 -- 172.21.15.46:0/1901784235 learned_addr learned my addr 172.21.15.46:0/1901784235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:32.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.156+0000 7fbcd6ffd640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd8150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.158+0000 7fbcd77fe640 1 -- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 msgr2=0x7fbcd8150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.158+0000 7fbcd77fe640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd8150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.159+0000 7fbcd77fe640 1 -- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd80c92e0 msgr2=0x7fbcd80ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.159+0000 7fbcd77fe640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd80c92e0 0x7fbcd80ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.159+0000 7fbcd77fe640 1 -- 172.21.15.46:0/1901784235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0009400 con 0x7fbcd80cf550 2024-01-27T13:32:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.161+0000 7fbcd77fe640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 0x7fbcd80cd500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800cb40 tx=0x7fbcc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.165+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc800aca0 con 0x7fbcd80cf550 2024-01-27T13:32:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.165+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc800ae20 con 0x7fbcd80cf550 2024-01-27T13:32:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.165+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd8151b00 con 0x7fbcd80cf550 2024-01-27T13:32:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.165+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8012640 con 0x7fbcd80cf550 2024-01-27T13:32:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.165+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd81f2d60 con 0x7fbcd80cf550 2024-01-27T13:32:32.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.166+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd8074410 con 0x7fbcd80cf550 2024-01-27T13:32:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.186+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbcc8007070 con 0x7fbcd80cf550 2024-01-27T13:32:32.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.186+0000 7fbccf7fe640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbcb806af20 0x7fbcb806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.186+0000 7fbcd6ffd640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbcb806af20 0x7fbcb806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.187+0000 7fbcd6ffd640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbcb806af20 0x7fbcb806d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0036000 tx=0x7fbcd003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:32.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.437+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcc8058720 con 0x7fbcd80cf550 2024-01-27T13:32:32.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.437+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbcc8054a60 con 0x7fbcd80cf550 2024-01-27T13:32:32.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.615+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbcd80c89f0 con 0x7fbcd80cf550 2024-01-27T13:32:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.620+0000 7fbccf7fe640 1 -- 172.21.15.46:0/1901784235 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbcc8017070 con 0x7fbcd80cf550 2024-01-27T13:32:32.612 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbcb806af20 msgr2=0x7fbcb806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbcb806af20 0x7fbcb806d3e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0036000 tx=0x7fbcd003b040 comp rx=0 tx=0).stop 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 msgr2=0x7fbcd80cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 0x7fbcd80cd500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800cb40 tx=0x7fbcc800a060 comp rx=0 tx=0).stop 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 shutdown_connections 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbcb806af20 0x7fbcb806d3e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcd80cf550 0x7fbcd80cd500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcd80c92e0 0x7fbcd80ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 --2- 172.21.15.46:0/1901784235 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbcd80c8f00 0x7fbcd8150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 >> 172.21.15.46:0/1901784235 conn(0x7fbcd808afd0 msgr2=0x7fbcd815bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:32.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 shutdown_connections 2024-01-27T13:32:32.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.622+0000 7fbcdd597640 1 -- 172.21.15.46:0/1901784235 wait complete. 2024-01-27T13:32:32.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T13:32:32.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.736+0000 7f8d102ec640 1 Processor -- start 2024-01-27T13:32:32.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.736+0000 7f8d102ec640 1 -- start start 2024-01-27T13:32:32.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.737+0000 7f8d102ec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d08153a50 0x7f8d080c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.737+0000 7f8d102ec640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d08159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.737+0000 7f8d102ec640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0815a300 con 0x7f8d080c77d0 2024-01-27T13:32:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.737+0000 7f8d102ec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080c9740 con 0x7f8d08153a50 2024-01-27T13:32:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.737+0000 7f8d102ec640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080c9480 con 0x7f8d08159950 2024-01-27T13:32:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.738+0000 7f8d0e088640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d08153a50 0x7f8d080c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.738+0000 7f8d0e889640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d08159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.738+0000 7f8d0d887640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d080c77d0 0x7f8d080c8040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:38774/0 (socket says 172.21.15.46:38774) 2024-01-27T13:32:32.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.738+0000 7f8d0d887640 1 -- 172.21.15.46:0/3220263145 learned_addr learned my addr 172.21.15.46:0/3220263145 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.740+0000 7f8d0e088640 1 -- 172.21.15.46:0/3220263145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 msgr2=0x7f8d08159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.740+0000 7f8d0e088640 1 --2- 172.21.15.46:0/3220263145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d08159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.740+0000 7f8d0e088640 1 -- 172.21.15.46:0/3220263145 >> v1:172.21.15.78:6789/0 conn(0x7f8d080c77d0 legacy=0x7f8d080c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.740+0000 7f8d0e088640 1 -- 172.21.15.46:0/3220263145 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0806bfb0 con 0x7f8d08153a50 2024-01-27T13:32:32.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.740+0000 7f8d0d086640 1 -- 172.21.15.46:0/3220263145 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272813432 0 0) 0x7f8d0815a300 con 0x7f8d080c77d0 2024-01-27T13:32:32.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.742+0000 7f8d0e088640 1 --2- 172.21.15.46:0/3220263145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d080c8b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097a0 tx=0x7f8d0002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5ec90a5e49dfaf server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.746+0000 7f8d0d086640 1 -- 172.21.15.46:0/3220263145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00030610 con 0x7f8d08153a50 2024-01-27T13:32:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.746+0000 7f8d0d086640 1 -- 172.21.15.46:0/3220263145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00030770 con 0x7f8d08153a50 2024-01-27T13:32:32.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.746+0000 7f8d0d086640 1 -- 172.21.15.46:0/3220263145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00030b00 con 0x7f8d08153a50 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 -- 172.21.15.46:0/3220263145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 msgr2=0x7f8d080c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 --2- 172.21.15.46:0/3220263145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d080c8b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097a0 tx=0x7f8d0002b960 comp rx=0 tx=0).stop 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 -- 172.21.15.46:0/3220263145 shutdown_connections 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 --2- 172.21.15.46:0/3220263145 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d08159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 --2- 172.21.15.46:0/3220263145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d080c8b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 -- 172.21.15.46:0/3220263145 >> 172.21.15.46:0/3220263145 conn(0x7f8d0806efe0 msgr2=0x7f8d0806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 -- 172.21.15.46:0/3220263145 shutdown_connections 2024-01-27T13:32:32.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.747+0000 7f8d102ec640 1 -- 172.21.15.46:0/3220263145 wait complete. 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.748+0000 7f8d102ec640 1 Processor -- start 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.748+0000 7f8d102ec640 1 -- start start 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d102ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d080c77d0 0x7f8d08156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d102ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d08155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d102ec640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d080c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d102ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08154140 con 0x7f8d08153a50 2024-01-27T13:32:32.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d102ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081543e0 con 0x7f8d080c77d0 2024-01-27T13:32:32.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d102ec640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081546c0 con 0x7f8d08159950 2024-01-27T13:32:32.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.749+0000 7f8d0d887640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d08155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.750+0000 7f8d0e088640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d080c77d0 0x7f8d08156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.750+0000 7f8d0d887640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d08155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59718/0 (socket says 172.21.15.46:59718) 2024-01-27T13:32:32.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.750+0000 7f8d0d887640 1 -- 172.21.15.46:0/2069530077 learned_addr learned my addr 172.21.15.46:0/2069530077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:32.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.750+0000 7f8d0e889640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d080c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.753+0000 7f8d0d887640 1 -- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 msgr2=0x7f8d080c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.753+0000 7f8d0d887640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d080c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.753+0000 7f8d0d887640 1 -- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d080c77d0 msgr2=0x7f8d08156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:32.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.753+0000 7f8d0d887640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d080c77d0 0x7f8d08156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:32.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.753+0000 7f8d0d887640 1 -- 172.21.15.46:0/2069530077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00009400 con 0x7f8d08153a50 2024-01-27T13:32:32.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.755+0000 7f8d0d887640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d08155480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c4a0 tx=0x7f8cfc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.759+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0074e0 con 0x7f8d08153a50 2024-01-27T13:32:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.759+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc007640 con 0x7f8d08153a50 2024-01-27T13:32:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.759+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d081549a0 con 0x7f8d08153a50 2024-01-27T13:32:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.759+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc004a00 con 0x7f8d08153a50 2024-01-27T13:32:32.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.759+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d08154f60 con 0x7f8d08153a50 2024-01-27T13:32:32.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.760+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d08074410 con 0x7f8d08153a50 2024-01-27T13:32:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.783+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8cfc01c3b0 con 0x7f8d08153a50 2024-01-27T13:32:32.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.783+0000 7f8d06ffd640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8cf406af50 0x7f8cf406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:32.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.784+0000 7f8d0e088640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8cf406af50 0x7f8cf406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:32.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.784+0000 7f8d0e088640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8cf406af50 0x7f8cf406d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d00036000 tx=0x7f8d00008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:32.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:32.787+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cfc057c50 con 0x7f8d08153a50 2024-01-27T13:32:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.040+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8cfc053f90 con 0x7f8d08153a50 2024-01-27T13:32:33.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.226+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d08155150 con 0x7f8d08153a50 2024-01-27T13:32:33.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.231+0000 7f8d06ffd640 1 -- 172.21.15.46:0/2069530077 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cfc018070 con 0x7f8d08153a50 2024-01-27T13:32:33.223 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8cf406af50 msgr2=0x7f8cf406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8cf406af50 0x7f8cf406d410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d00036000 tx=0x7f8d00008030 comp rx=0 tx=0).stop 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 msgr2=0x7f8d08155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d08155480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00c4a0 tx=0x7f8cfc00c960 comp rx=0 tx=0).stop 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 shutdown_connections 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8cf406af50 0x7f8cf406d410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d08159950 0x7f8d080c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d08153a50 0x7f8d08155480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 --2- 172.21.15.46:0/2069530077 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d080c77d0 0x7f8d08156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 >> 172.21.15.46:0/2069530077 conn(0x7f8d0806efe0 msgr2=0x7f8d08151010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 shutdown_connections 2024-01-27T13:32:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.233+0000 7f8d102ec640 1 -- 172.21.15.46:0/2069530077 wait complete. 2024-01-27T13:32:33.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T13:32:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.348+0000 7fed06c63640 1 Processor -- start 2024-01-27T13:32:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.348+0000 7fed06c63640 1 -- start start 2024-01-27T13:32:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.349+0000 7fed06c63640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed000c8f00 0x7fed000cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.349+0000 7fed06c63640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed000ca9f0 con 0x7fed000c92e0 2024-01-27T13:32:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.349+0000 7fed06c63640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed00159d50 con 0x7fed000cf550 2024-01-27T13:32:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.349+0000 7fed06c63640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed000cc9c0 con 0x7fed000c8f00 2024-01-27T13:32:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.350+0000 7fed049ff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed000c8f00 0x7fed000cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.350+0000 7fecfffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fed000c92e0 0x7fed0015cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60074/0 (socket says 172.21.15.46:60074) 2024-01-27T13:32:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.350+0000 7fecfffff640 1 -- 172.21.15.46:0/2362870446 learned_addr learned my addr 172.21.15.46:0/2362870446 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.353+0000 7fecff7fe640 1 -- 172.21.15.46:0/2362870446 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813048122 0 0) 0x7fed00159d50 con 0x7fed000cf550 2024-01-27T13:32:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.353+0000 7fecff7fe640 1 -- 172.21.15.46:0/2362870446 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf0003520 con 0x7fed000cf550 2024-01-27T13:32:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.353+0000 7fed049ff640 1 -- 172.21.15.46:0/2362870446 >> v1:172.21.15.78:6789/0 conn(0x7fed000cf550 legacy=0x7fed000cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.353+0000 7fed049ff640 1 -- 172.21.15.46:0/2362870446 >> v1:172.21.15.46:6789/0 conn(0x7fed000c92e0 legacy=0x7fed0015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.353+0000 7fed049ff640 1 -- 172.21.15.46:0/2362870446 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000cc6e0 con 0x7fed000c8f00 2024-01-27T13:32:33.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.357+0000 7fed049ff640 1 --2- 172.21.15.46:0/2362870446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c8f00 0x7fed000cf010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fecf40097a0 tx=0x7fecf402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac291feed1ff82 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fecff7fe640 1 -- 172.21.15.46:0/2362870446 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf402f810 con 0x7fed000c8f00 2024-01-27T13:32:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fecff7fe640 1 -- 172.21.15.46:0/2362870446 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf402f970 con 0x7fed000c8f00 2024-01-27T13:32:33.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fecff7fe640 1 -- 172.21.15.46:0/2362870446 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf402fd00 con 0x7fed000c8f00 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fed06c63640 1 -- 172.21.15.46:0/2362870446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c8f00 msgr2=0x7fed000cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fed06c63640 1 --2- 172.21.15.46:0/2362870446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c8f00 0x7fed000cf010 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fecf40097a0 tx=0x7fecf402b9f0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fed06c63640 1 -- 172.21.15.46:0/2362870446 shutdown_connections 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fed06c63640 1 --2- 172.21.15.46:0/2362870446 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c8f00 0x7fed000cf010 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.361+0000 7fed06c63640 1 -- 172.21.15.46:0/2362870446 >> 172.21.15.46:0/2362870446 conn(0x7fed0008afd0 msgr2=0x7fed0008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.362+0000 7fed06c63640 1 -- 172.21.15.46:0/2362870446 shutdown_connections 2024-01-27T13:32:33.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.362+0000 7fed06c63640 1 -- 172.21.15.46:0/2362870446 wait complete. 2024-01-27T13:32:33.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 Processor -- start 2024-01-27T13:32:33.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 -- start start 2024-01-27T13:32:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed000c8f00 0x7fed00157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 0x7fed00152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed000cf550 0x7fed00155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00159890 con 0x7fed000c92e0 2024-01-27T13:32:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00157ff0 con 0x7fed000cf550 2024-01-27T13:32:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.363+0000 7fed06c63640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed00156810 con 0x7fed000c8f00 2024-01-27T13:32:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.364+0000 7fecfffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 0x7fed00152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.364+0000 7fecfffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 0x7fed00152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59734/0 (socket says 172.21.15.46:59734) 2024-01-27T13:32:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.364+0000 7fecfffff640 1 -- 172.21.15.46:0/2359866870 learned_addr learned my addr 172.21.15.46:0/2359866870 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.364+0000 7fed05200640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed000cf550 0x7fed00155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.364+0000 7fed049ff640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed000c8f00 0x7fed00157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.368+0000 7fecfffff640 1 -- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed000c8f00 msgr2=0x7fed00157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.368+0000 7fecfffff640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed000c8f00 0x7fed00157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.368+0000 7fecfffff640 1 -- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed000cf550 msgr2=0x7fed00155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.368+0000 7fecfffff640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed000cf550 0x7fed00155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.368+0000 7fecfffff640 1 -- 172.21.15.46:0/2359866870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4009400 con 0x7fed000c92e0 2024-01-27T13:32:33.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.370+0000 7fecfffff640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 0x7fed00152b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c470 tx=0x7fecec001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:33.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.374+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec005ce0 con 0x7fed000c92e0 2024-01-27T13:32:33.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.374+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec005e40 con 0x7fed000c92e0 2024-01-27T13:32:33.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.374+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed00156550 con 0x7fed000c92e0 2024-01-27T13:32:33.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.374+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0072f0 con 0x7fed000c92e0 2024-01-27T13:32:33.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.374+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed001eede0 con 0x7fed000c92e0 2024-01-27T13:32:33.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.375+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed00074410 con 0x7fed000c92e0 2024-01-27T13:32:33.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.639+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fecec007450 con 0x7fed000c92e0 2024-01-27T13:32:33.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.640+0000 7fecfd7fa640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fece406af20 0x7fece406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.640+0000 7fed049ff640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fece406af20 0x7fece406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.640+0000 7fed049ff640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fece406af20 0x7fece406d3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fecf4036000 tx=0x7fecf4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:33.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.654+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecec057f80 con 0x7fed000c92e0 2024-01-27T13:32:33.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.654+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fecec0542c0 con 0x7fed000c92e0 2024-01-27T13:32:33.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.852+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed000c99d0 con 0x7fed000c92e0 2024-01-27T13:32:33.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.858+0000 7fecfd7fa640 1 -- 172.21.15.46:0/2359866870 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecec017070 con 0x7fed000c92e0 2024-01-27T13:32:33.850 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T13:32:33.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fece406af20 msgr2=0x7fece406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fece406af20 0x7fece406d3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fecf4036000 tx=0x7fecf4008030 comp rx=0 tx=0).stop 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 msgr2=0x7fed00152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 0x7fed00152b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c470 tx=0x7fecec001e70 comp rx=0 tx=0).stop 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 shutdown_connections 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fece406af20 0x7fece406d3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed000cf550 0x7fed00155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed000c92e0 0x7fed00152b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 --2- 172.21.15.46:0/2359866870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed000c8f00 0x7fed00157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 >> 172.21.15.46:0/2359866870 conn(0x7fed0008afd0 msgr2=0x7fed0015ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 shutdown_connections 2024-01-27T13:32:33.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.860+0000 7fed06c63640 1 -- 172.21.15.46:0/2359866870 wait complete. 2024-01-27T13:32:33.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T13:32:33.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.975+0000 7f02ff31d640 1 Processor -- start 2024-01-27T13:32:33.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.975+0000 7f02ff31d640 1 -- start start 2024-01-27T13:32:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.975+0000 7f02ff31d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f02f80c92e0 0x7f02f80cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.975+0000 7f02ff31d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80ca9f0 con 0x7f02f80c8f00 2024-01-27T13:32:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.975+0000 7f02ff31d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f8159d50 con 0x7f02f80cb3c0 2024-01-27T13:32:33.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.975+0000 7f02ff31d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80cc9c0 con 0x7f02f80c92e0 2024-01-27T13:32:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.976+0000 7f02fd0b9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f02f80c8f00 0x7f02f80cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:60090/0 (socket says 172.21.15.46:60090) 2024-01-27T13:32:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.976+0000 7f02fd0b9640 1 -- 172.21.15.46:0/2574848009 learned_addr learned my addr 172.21.15.46:0/2574848009 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:33.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.976+0000 7f02fc8b8640 1 --2- 172.21.15.46:0/2574848009 >> v2:172.21.15.78:3300/0 conn(0x7f02f80c92e0 0x7f02f80cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.979+0000 7f02effff640 1 -- 172.21.15.46:0/2574848009 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280711912 0 0) 0x7f02f80ca9f0 con 0x7f02f80c8f00 2024-01-27T13:32:33.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.979+0000 7f02effff640 1 -- 172.21.15.46:0/2574848009 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e4003520 con 0x7f02f80c8f00 2024-01-27T13:32:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.982+0000 7f02fc8b8640 1 -- 172.21.15.46:0/2574848009 >> v1:172.21.15.78:6789/0 conn(0x7f02f80cb3c0 legacy=0x7f02f80cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.982+0000 7f02fc8b8640 1 -- 172.21.15.46:0/2574848009 >> v1:172.21.15.46:6789/0 conn(0x7f02f80c8f00 legacy=0x7f02f80cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.982+0000 7f02fc8b8640 1 -- 172.21.15.46:0/2574848009 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80cc6e0 con 0x7f02f80c92e0 2024-01-27T13:32:33.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.986+0000 7f02fc8b8640 1 --2- 172.21.15.46:0/2574848009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80c92e0 0x7f02f80cae80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02e80097a0 tx=0x7f02e802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32e271419569f8ed server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:33.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.990+0000 7f02effff640 1 -- 172.21.15.46:0/2574848009 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e802f810 con 0x7f02f80c92e0 2024-01-27T13:32:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.990+0000 7f02effff640 1 -- 172.21.15.46:0/2574848009 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e802f970 con 0x7f02f80c92e0 2024-01-27T13:32:33.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.990+0000 7f02effff640 1 -- 172.21.15.46:0/2574848009 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e802fd00 con 0x7f02f80c92e0 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 -- 172.21.15.46:0/2574848009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80c92e0 msgr2=0x7f02f80cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2574848009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80c92e0 0x7f02f80cae80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f02e80097a0 tx=0x7f02e802b9f0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 -- 172.21.15.46:0/2574848009 shutdown_connections 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2574848009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80c92e0 0x7f02f80cae80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 -- 172.21.15.46:0/2574848009 >> 172.21.15.46:0/2574848009 conn(0x7f02f808afd0 msgr2=0x7f02f808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 -- 172.21.15.46:0/2574848009 shutdown_connections 2024-01-27T13:32:33.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.991+0000 7f02ff31d640 1 -- 172.21.15.46:0/2574848009 wait complete. 2024-01-27T13:32:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.992+0000 7f02ff31d640 1 Processor -- start 2024-01-27T13:32:33.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.992+0000 7f02ff31d640 1 -- start start 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.993+0000 7f02ff31d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 0x7f02f80b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.993+0000 7f02ff31d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f02f80c92e0 0x7f02f81f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.993+0000 7f02ff31d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80cb3c0 0x7f02f8157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.993+0000 7f02ff31d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8155380 con 0x7f02f80c8f00 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.993+0000 7f02ff31d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80b3620 con 0x7f02f80cb3c0 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.993+0000 7f02ff31d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80c2490 con 0x7f02f80c92e0 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.994+0000 7f02fd0b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 0x7f02f80b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.994+0000 7f02fd8ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80cb3c0 0x7f02f8157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.994+0000 7f02fd0b9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 0x7f02f80b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59746/0 (socket says 172.21.15.46:59746) 2024-01-27T13:32:33.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.994+0000 7f02fd0b9640 1 -- 172.21.15.46:0/2682242148 learned_addr learned my addr 172.21.15.46:0/2682242148 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.994+0000 7f02fc8b8640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f02f80c92e0 0x7f02f81f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:33.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.997+0000 7f02fd0b9640 1 -- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f02f80c92e0 msgr2=0x7f02f81f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.997+0000 7f02fd0b9640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f02f80c92e0 0x7f02f81f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.997+0000 7f02fd0b9640 1 -- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80cb3c0 msgr2=0x7f02f8157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:33.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.997+0000 7f02fd0b9640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80cb3c0 0x7f02f8157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:33.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.997+0000 7f02fd0b9640 1 -- 172.21.15.46:0/2682242148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009400 con 0x7f02f80c8f00 2024-01-27T13:32:33.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:33.999+0000 7f02fd0b9640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 0x7f02f80b30e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c460 tx=0x7f02f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:33.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.003+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4005ce0 con 0x7f02f80c8f00 2024-01-27T13:32:33.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.003+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f4005e40 con 0x7f02f80c8f00 2024-01-27T13:32:33.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.003+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4007290 con 0x7f02f80c8f00 2024-01-27T13:32:33.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.003+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f80cf4b0 con 0x7f02f80c8f00 2024-01-27T13:32:33.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.003+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f80c2730 con 0x7f02f80c8f00 2024-01-27T13:32:33.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.004+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f8074410 con 0x7f02f80c8f00 2024-01-27T13:32:34.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.024+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f02f40073f0 con 0x7f02f80c8f00 2024-01-27T13:32:34.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.024+0000 7f02edffb640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f02dc06af20 0x7f02dc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.024+0000 7f02fc8b8640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f02dc06af20 0x7f02dc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.025+0000 7f02fc8b8640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f02dc06af20 0x7f02dc06d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02e8036000 tx=0x7f02e8008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:34.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.026+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02f4057be0 con 0x7f02f80c8f00 2024-01-27T13:32:34.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.281+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f02f4053f20 con 0x7f02f80c8f00 2024-01-27T13:32:34.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.467+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f02f80c8640 con 0x7f02f80c8f00 2024-01-27T13:32:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.479+0000 7f02edffb640 1 -- 172.21.15.46:0/2682242148 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02f4057540 con 0x7f02f80c8f00 2024-01-27T13:32:34.471 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f02dc06af20 msgr2=0x7f02dc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f02dc06af20 0x7f02dc06d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02e8036000 tx=0x7f02e8008030 comp rx=0 tx=0).stop 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 msgr2=0x7f02f80b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 0x7f02f80b30e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c460 tx=0x7f02f400c920 comp rx=0 tx=0).stop 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 shutdown_connections 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f02dc06af20 0x7f02dc06d3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02f80cb3c0 0x7f02f8157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f02f80c92e0 0x7f02f81f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 --2- 172.21.15.46:0/2682242148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02f80c8f00 0x7f02f80b30e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 >> 172.21.15.46:0/2682242148 conn(0x7f02f808afd0 msgr2=0x7f02f80c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:34.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 shutdown_connections 2024-01-27T13:32:34.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.481+0000 7f02ff31d640 1 -- 172.21.15.46:0/2682242148 wait complete. 2024-01-27T13:32:34.485 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T13:32:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.595+0000 7ff577a3c640 1 Processor -- start 2024-01-27T13:32:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.595+0000 7ff577a3c640 1 -- start start 2024-01-27T13:32:34.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.596+0000 7ff577a3c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5700c8f00 0x7ff5700cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.596+0000 7ff577a3c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff5700c92e0 0x7ff5700cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.596+0000 7ff577a3c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5700ca9f0 con 0x7ff57015cf00 2024-01-27T13:32:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.596+0000 7ff577a3c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700cc9c0 con 0x7ff5700c92e0 2024-01-27T13:32:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.596+0000 7ff577a3c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff570159d50 con 0x7ff5700c8f00 2024-01-27T13:32:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.597+0000 7ff5757d8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5700c8f00 0x7ff5700cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.597+0000 7ff575fd9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ff57015cf00 0x7ff57015d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33688/0 (socket says 172.21.15.46:33688) 2024-01-27T13:32:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.597+0000 7ff575fd9640 1 -- 172.21.15.46:0/3297057524 learned_addr learned my addr 172.21.15.46:0/3297057524 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:34.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.597+0000 7ff574fd7640 1 --2- 172.21.15.46:0/3297057524 >> v2:172.21.15.46:3300/0 conn(0x7ff5700c92e0 0x7ff5700cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.600+0000 7ff5757d8640 1 -- 172.21.15.46:0/3297057524 >> v2:172.21.15.46:3300/0 conn(0x7ff5700c92e0 msgr2=0x7ff5700cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.600+0000 7ff5757d8640 1 --2- 172.21.15.46:0/3297057524 >> v2:172.21.15.46:3300/0 conn(0x7ff5700c92e0 0x7ff5700cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.600+0000 7ff5757d8640 1 -- 172.21.15.46:0/3297057524 >> v1:172.21.15.46:6789/0 conn(0x7ff57015cf00 legacy=0x7ff57015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:34.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.600+0000 7ff5757d8640 1 -- 172.21.15.46:0/3297057524 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700cc6e0 con 0x7ff5700c8f00 2024-01-27T13:32:34.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.602+0000 7ff5757d8640 1 --2- 172.21.15.46:0/3297057524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5700c8f00 0x7ff5700cf010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff560009d90 tx=0x7ff56002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fa1d55c14f674c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.605+0000 7ff56ffff640 1 -- 172.21.15.46:0/3297057524 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56002cce0 con 0x7ff5700c8f00 2024-01-27T13:32:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff56ffff640 1 -- 172.21.15.46:0/3297057524 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56002ce40 con 0x7ff5700c8f00 2024-01-27T13:32:34.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff56ffff640 1 -- 172.21.15.46:0/3297057524 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff560034660 con 0x7ff5700c8f00 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 -- 172.21.15.46:0/3297057524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5700c8f00 msgr2=0x7ff5700cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 --2- 172.21.15.46:0/3297057524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5700c8f00 0x7ff5700cf010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff560009d90 tx=0x7ff56002bf30 comp rx=0 tx=0).stop 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 -- 172.21.15.46:0/3297057524 shutdown_connections 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 --2- 172.21.15.46:0/3297057524 >> v2:172.21.15.46:3300/0 conn(0x7ff5700c92e0 0x7ff5700cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 --2- 172.21.15.46:0/3297057524 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff5700c8f00 0x7ff5700cf010 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 -- 172.21.15.46:0/3297057524 >> 172.21.15.46:0/3297057524 conn(0x7ff57008afd0 msgr2=0x7ff57008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 -- 172.21.15.46:0/3297057524 shutdown_connections 2024-01-27T13:32:34.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.606+0000 7ff577a3c640 1 -- 172.21.15.46:0/3297057524 wait complete. 2024-01-27T13:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.607+0000 7ff577a3c640 1 Processor -- start 2024-01-27T13:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.607+0000 7ff577a3c640 1 -- start start 2024-01-27T13:32:34.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.608+0000 7ff577a3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5700c8f00 0x7ff5701efab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.608+0000 7ff577a3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 0x7ff5701e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.608+0000 7ff577a3c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff57015cf00 0x7ff570155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.608+0000 7ff577a3c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700c5380 con 0x7ff5700c92e0 2024-01-27T13:32:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.608+0000 7ff577a3c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5701efff0 con 0x7ff5700c8f00 2024-01-27T13:32:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.608+0000 7ff577a3c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff570155000 con 0x7ff57015cf00 2024-01-27T13:32:34.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.609+0000 7ff574fd7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 0x7ff5701e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.609+0000 7ff574fd7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 0x7ff5701e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50182/0 (socket says 172.21.15.46:50182) 2024-01-27T13:32:34.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.609+0000 7ff574fd7640 1 -- 172.21.15.46:0/968005168 learned_addr learned my addr 172.21.15.46:0/968005168 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:34.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.609+0000 7ff575fd9640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff57015cf00 0x7ff570155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.609+0000 7ff5757d8640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5700c8f00 0x7ff5701efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.612+0000 7ff574fd7640 1 -- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff57015cf00 msgr2=0x7ff570155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.612+0000 7ff574fd7640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff57015cf00 0x7ff570155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.612+0000 7ff574fd7640 1 -- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5700c8f00 msgr2=0x7ff5701efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.612+0000 7ff574fd7640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5700c8f00 0x7ff5701efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:34.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.612+0000 7ff574fd7640 1 -- 172.21.15.46:0/968005168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560009a70 con 0x7ff5700c92e0 2024-01-27T13:32:34.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.615+0000 7ff574fd7640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 0x7ff5701e35c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff56400d800 tx=0x7ff56400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.619+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400b660 con 0x7ff5700c92e0 2024-01-27T13:32:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.619+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400b7c0 con 0x7ff5700c92e0 2024-01-27T13:32:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.619+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400bb50 con 0x7ff5700c92e0 2024-01-27T13:32:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.619+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5700c46d0 con 0x7ff5700c92e0 2024-01-27T13:32:34.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.619+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5700c4c90 con 0x7ff5700c92e0 2024-01-27T13:32:34.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.620+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff570074410 con 0x7ff5700c92e0 2024-01-27T13:32:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.886+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff56400bcb0 con 0x7ff5700c92e0 2024-01-27T13:32:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.886+0000 7ff56dffb640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff55c06af20 0x7ff55c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.887+0000 7ff5757d8640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff55c06af20 0x7ff55c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:34.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.887+0000 7ff5757d8640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff55c06af20 0x7ff55c06d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff560036000 tx=0x7ff560030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.899+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff564059170 con 0x7ff5700c92e0 2024-01-27T13:32:34.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:34.899+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff5640554b0 con 0x7ff5700c92e0 2024-01-27T13:32:35.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.096+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff5701e4a60 con 0x7ff5700c92e0 2024-01-27T13:32:35.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.101+0000 7ff56dffb640 1 -- 172.21.15.46:0/968005168 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff564058ad0 con 0x7ff5700c92e0 2024-01-27T13:32:35.094 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T13:32:35.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff55c06af20 msgr2=0x7ff55c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:35.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff55c06af20 0x7ff55c06d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff560036000 tx=0x7ff560030000 comp rx=0 tx=0).stop 2024-01-27T13:32:35.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 msgr2=0x7ff5701e35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:35.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 0x7ff5701e35c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff56400d800 tx=0x7ff56400dcc0 comp rx=0 tx=0).stop 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 shutdown_connections 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff55c06af20 0x7ff55c06d3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff57015cf00 0x7ff570155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5700c92e0 0x7ff5701e35c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 --2- 172.21.15.46:0/968005168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5700c8f00 0x7ff5701efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 >> 172.21.15.46:0/968005168 conn(0x7ff57008afd0 msgr2=0x7ff57015c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 shutdown_connections 2024-01-27T13:32:35.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:35.103+0000 7ff577a3c640 1 -- 172.21.15.46:0/968005168 wait complete. 2024-01-27T13:32:35.106 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-01-27T13:32:35.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:35.106 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-01-27T13:32:35.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi046.stderr:ceph-fuse[42169]: fuse finished with error 0 and tester_r 0 2024-01-27T13:32:35.133 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T13:32:41.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T13:32:41.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:32:41.235 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-01-27T13:32:41.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:41.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.419+0000 7f9f8e2c2640 1 Processor -- start 2024-01-27T13:32:41.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.419+0000 7f9f8e2c2640 1 -- start start 2024-01-27T13:32:41.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.420+0000 7f9f8e2c2640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f88159950 0x7f9f88159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:41.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.420+0000 7f9f8e2c2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f880c9480 con 0x7f9f88153a50 2024-01-27T13:32:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.420+0000 7f9f8e2c2640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8815a2c0 con 0x7f9f880c77d0 2024-01-27T13:32:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.420+0000 7f9f8e2c2640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880c9740 con 0x7f9f88159950 2024-01-27T13:32:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.421+0000 7f9f8c85f640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9f88159950 0x7f9f88159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.421+0000 7f9f877fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9f880c77d0 0x7f9f880c8040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:55132/0 (socket says 172.21.15.46:55132) 2024-01-27T13:32:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.421+0000 7f9f877fe640 1 -- 172.21.15.46:0/2784533843 learned_addr learned my addr 172.21.15.46:0/2784533843 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.423+0000 7f9f86ffd640 1 -- 172.21.15.46:0/2784533843 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498074724 0 0) 0x7f9f8815a2c0 con 0x7f9f880c77d0 2024-01-27T13:32:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.423+0000 7f9f86ffd640 1 -- 172.21.15.46:0/2784533843 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f70003520 con 0x7f9f880c77d0 2024-01-27T13:32:41.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.424+0000 7f9f8c85f640 1 -- 172.21.15.46:0/2784533843 >> v1:172.21.15.78:6789/0 conn(0x7f9f880c77d0 legacy=0x7f9f880c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.424+0000 7f9f8c85f640 1 -- 172.21.15.46:0/2784533843 >> v1:172.21.15.46:6789/0 conn(0x7f9f88153a50 legacy=0x7f9f880c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.424+0000 7f9f8c85f640 1 -- 172.21.15.46:0/2784533843 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8806bfb0 con 0x7f9f88159950 2024-01-27T13:32:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.427+0000 7f9f8c85f640 1 --2- 172.21.15.46:0/2784533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88159950 0x7f9f88159d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009d90 tx=0x7f9f8002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47f7971e801374a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.432+0000 7f9f86ffd640 1 -- 172.21.15.46:0/2784533843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8002cd80 con 0x7f9f88159950 2024-01-27T13:32:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.432+0000 7f9f86ffd640 1 -- 172.21.15.46:0/2784533843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80034440 con 0x7f9f88159950 2024-01-27T13:32:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.432+0000 7f9f86ffd640 1 -- 172.21.15.46:0/2784533843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800347d0 con 0x7f9f88159950 2024-01-27T13:32:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/2784533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88159950 msgr2=0x7f9f88159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/2784533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88159950 0x7f9f88159d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009d90 tx=0x7f9f8002bfd0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/2784533843 shutdown_connections 2024-01-27T13:32:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/2784533843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88159950 0x7f9f88159d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/2784533843 >> 172.21.15.46:0/2784533843 conn(0x7f9f8806efe0 msgr2=0x7f9f8806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/2784533843 shutdown_connections 2024-01-27T13:32:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.433+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/2784533843 wait complete. 2024-01-27T13:32:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.434+0000 7f9f8e2c2640 1 Processor -- start 2024-01-27T13:32:41.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 -- start start 2024-01-27T13:32:41.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f880c77d0 0x7f9f880b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 0x7f9f88155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f88159950 0x7f9f880c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8814f680 con 0x7f9f88153a50 2024-01-27T13:32:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881561b0 con 0x7f9f88159950 2024-01-27T13:32:41.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.435+0000 7f9f8e2c2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881557e0 con 0x7f9f880c77d0 2024-01-27T13:32:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.436+0000 7f9f877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 0x7f9f88155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.436+0000 7f9f8c85f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f88159950 0x7f9f880c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.436+0000 7f9f877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 0x7f9f88155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50212/0 (socket says 172.21.15.46:50212) 2024-01-27T13:32:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.436+0000 7f9f877fe640 1 -- 172.21.15.46:0/1296706979 learned_addr learned my addr 172.21.15.46:0/1296706979 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:41.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.436+0000 7f9f87fff640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f880c77d0 0x7f9f880b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:41.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.440+0000 7f9f877fe640 1 -- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f880c77d0 msgr2=0x7f9f880b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.440+0000 7f9f877fe640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f880c77d0 0x7f9f880b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.440+0000 7f9f877fe640 1 -- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f88159950 msgr2=0x7f9f880c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.440+0000 7f9f877fe640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f88159950 0x7f9f880c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.440+0000 7f9f877fe640 1 -- 172.21.15.46:0/1296706979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009a70 con 0x7f9f88153a50 2024-01-27T13:32:41.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.442+0000 7f9f877fe640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 0x7f9f88155c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c460 tx=0x7f9f7c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:41.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.445+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c005ce0 con 0x7f9f88153a50 2024-01-27T13:32:41.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.446+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c005e40 con 0x7f9f88153a50 2024-01-27T13:32:41.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.446+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f88151f70 con 0x7f9f88153a50 2024-01-27T13:32:41.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.446+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c007290 con 0x7f9f88153a50 2024-01-27T13:32:41.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.446+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f88156e50 con 0x7f9f88153a50 2024-01-27T13:32:41.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.447+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88155950 con 0x7f9f88153a50 2024-01-27T13:32:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.709+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9f7c0073f0 con 0x7f9f88153a50 2024-01-27T13:32:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.710+0000 7f9f84ff9640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9f7406af20 0x7f9f7406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:41.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.710+0000 7f9f87fff640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9f7406af20 0x7f9f7406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:41.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.710+0000 7f9f87fff640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9f7406af20 0x7f9f7406d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f78001780 tx=0x7f9f78009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:41.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.725+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f7c057fa0 con 0x7f9f88153a50 2024-01-27T13:32:41.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.725+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9f7c0542e0 con 0x7f9f88153a50 2024-01-27T13:32:41.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.926+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f88074410 con 0x7f9f88153a50 2024-01-27T13:32:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.966+0000 7f9f84ff9640 1 -- 172.21.15.46:0/1296706979 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f9f7c057900 con 0x7f9f88153a50 2024-01-27T13:32:41.958 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:41.959 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9f7406af20 msgr2=0x7f9f7406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9f7406af20 0x7f9f7406d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f78001780 tx=0x7f9f78009040 comp rx=0 tx=0).stop 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 msgr2=0x7f9f88155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 0x7f9f88155c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c460 tx=0x7f9f7c00c920 comp rx=0 tx=0).stop 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 shutdown_connections 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9f7406af20 0x7f9f7406d3e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9f88159950 0x7f9f880c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f88153a50 0x7f9f88155c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.968+0000 7f9f8e2c2640 1 --2- 172.21.15.46:0/1296706979 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9f880c77d0 0x7f9f880b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.969+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 >> 172.21.15.46:0/1296706979 conn(0x7f9f8806efe0 msgr2=0x7f9f880c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.969+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 shutdown_connections 2024-01-27T13:32:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:41.969+0000 7f9f8e2c2640 1 -- 172.21.15.46:0/1296706979 wait complete. 2024-01-27T13:32:41.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:42.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.083+0000 7f5f595ea640 1 Processor -- start 2024-01-27T13:32:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.083+0000 7f5f595ea640 1 -- start start 2024-01-27T13:32:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.084+0000 7f5f595ea640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f540c8f00 0x7f5f540cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.084+0000 7f5f595ea640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f540c92e0 0x7f5f540cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.084+0000 7f5f595ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f540ca9f0 con 0x7f5f5415cf00 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.084+0000 7f5f595ea640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f540cc9c0 con 0x7f5f540c8f00 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.084+0000 7f5f595ea640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54159d50 con 0x7f5f540c92e0 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.084+0000 7f5f52ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5f540c8f00 0x7f5f540cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.085+0000 7f5f537fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5f5415cf00 0x7f5f5415d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:55144/0 (socket says 172.21.15.46:55144) 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.085+0000 7f5f537fe640 1 -- 172.21.15.46:0/3290903448 learned_addr learned my addr 172.21.15.46:0/3290903448 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:42.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.085+0000 7f5f527fc640 1 --2- 172.21.15.46:0/3290903448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f540c92e0 0x7f5f540cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.087+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3290903448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f540c92e0 msgr2=0x7f5f540cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:42.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.087+0000 7f5f52ffd640 1 --2- 172.21.15.46:0/3290903448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f540c92e0 0x7f5f540cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.087+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3290903448 >> v1:172.21.15.78:6789/0 conn(0x7f5f5415cf00 legacy=0x7f5f5415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.087+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3290903448 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540cc6e0 con 0x7f5f540c8f00 2024-01-27T13:32:42.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.090+0000 7f5f52ffd640 1 --2- 172.21.15.46:0/3290903448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540cf010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009d90 tx=0x7f5f4402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8527476216e41c74 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:42.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f51ffb640 1 -- 172.21.15.46:0/3290903448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4402cce0 con 0x7f5f540c8f00 2024-01-27T13:32:42.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f51ffb640 1 -- 172.21.15.46:0/3290903448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4402ce40 con 0x7f5f540c8f00 2024-01-27T13:32:42.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f51ffb640 1 -- 172.21.15.46:0/3290903448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44034660 con 0x7f5f540c8f00 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 -- 172.21.15.46:0/3290903448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 msgr2=0x7f5f540cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3290903448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540cf010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009d90 tx=0x7f5f4402bf30 comp rx=0 tx=0).stop 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 -- 172.21.15.46:0/3290903448 shutdown_connections 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3290903448 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f540c92e0 0x7f5f540cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3290903448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540cf010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 -- 172.21.15.46:0/3290903448 >> 172.21.15.46:0/3290903448 conn(0x7f5f5408afd0 msgr2=0x7f5f5408b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 -- 172.21.15.46:0/3290903448 shutdown_connections 2024-01-27T13:32:42.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.094+0000 7f5f595ea640 1 -- 172.21.15.46:0/3290903448 wait complete. 2024-01-27T13:32:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.096+0000 7f5f595ea640 1 Processor -- start 2024-01-27T13:32:42.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.096+0000 7f5f595ea640 1 -- start start 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.096+0000 7f5f595ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f595ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f540c92e0 0x7f5f541efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f595ea640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f5415cf00 0x7f5f541e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f595ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540c4650 con 0x7f5f540c8f00 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f595ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f540c4d30 con 0x7f5f540c92e0 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f595ea640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f541f00a0 con 0x7f5f5415cf00 2024-01-27T13:32:42.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f52ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f537fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f5415cf00 0x7f5f541e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f527fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f540c92e0 0x7f5f541efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f52ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50230/0 (socket says 172.21.15.46:50230) 2024-01-27T13:32:42.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.097+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3875576515 learned_addr learned my addr 172.21.15.46:0/3875576515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.101+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3875576515 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f5415cf00 msgr2=0x7f5f541e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.101+0000 7f5f52ffd640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f5415cf00 0x7f5f541e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.101+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3875576515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f540c92e0 msgr2=0x7f5f541efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.101+0000 7f5f52ffd640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f540c92e0 0x7f5f541efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.101+0000 7f5f52ffd640 1 -- 172.21.15.46:0/3875576515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009a70 con 0x7f5f540c8f00 2024-01-27T13:32:42.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.103+0000 7f5f52ffd640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540c4110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009eb0 tx=0x7f5f44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.107+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4403d600 con 0x7f5f540c8f00 2024-01-27T13:32:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.107+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4403d760 con 0x7f5f540c8f00 2024-01-27T13:32:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.107+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f540c3670 con 0x7f5f540c8f00 2024-01-27T13:32:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.107+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4403db10 con 0x7f5f540c8f00 2024-01-27T13:32:42.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.107+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f540c57c0 con 0x7f5f540c8f00 2024-01-27T13:32:42.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.108+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54074410 con 0x7f5f540c8f00 2024-01-27T13:32:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.371+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5f4403b040 con 0x7f5f540c8f00 2024-01-27T13:32:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.372+0000 7f5f4b7fe640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5f3406af50 0x7f5f3406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.372+0000 7f5f527fc640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5f3406af50 0x7f5f3406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.372+0000 7f5f527fc640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5f3406af50 0x7f5f3406d410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5f541e4900 tx=0x7f5f3c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:42.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.386+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f4407a880 con 0x7f5f540c8f00 2024-01-27T13:32:42.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.387+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5f440d7190 con 0x7f5f540c8f00 2024-01-27T13:32:42.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.566+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f541e4930 con 0x7f5f540c8f00 2024-01-27T13:32:42.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.607+0000 7f5f4b7fe640 1 -- 172.21.15.46:0/3875576515 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7f5f4404d090 con 0x7f5f540c8f00 2024-01-27T13:32:42.599 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:42.600 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5f3406af50 msgr2=0x7f5f3406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5f3406af50 0x7f5f3406d410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5f541e4900 tx=0x7f5f3c009190 comp rx=0 tx=0).stop 2024-01-27T13:32:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 msgr2=0x7f5f540c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540c4110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009eb0 tx=0x7f5f44004a40 comp rx=0 tx=0).stop 2024-01-27T13:32:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 shutdown_connections 2024-01-27T13:32:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5f3406af50 0x7f5f3406d410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5f5415cf00 0x7f5f541e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f540c92e0 0x7f5f541efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 --2- 172.21.15.46:0/3875576515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f540c8f00 0x7f5f540c4110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 >> 172.21.15.46:0/3875576515 conn(0x7f5f5408afd0 msgr2=0x7f5f540c6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 shutdown_connections 2024-01-27T13:32:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.609+0000 7f5f595ea640 1 -- 172.21.15.46:0/3875576515 wait complete. 2024-01-27T13:32:42.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-27T13:32:42.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.724+0000 7ffa59f0f640 1 Processor -- start 2024-01-27T13:32:42.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.724+0000 7ffa59f0f640 1 -- start start 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.725+0000 7ffa59f0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffa540c28c0 0x7ffa540c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.725+0000 7ffa59f0f640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540ccf60 con 0x7ffa540c2ca0 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.725+0000 7ffa59f0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540ca800 con 0x7ffa54151c00 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.725+0000 7ffa59f0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa541576d0 con 0x7ffa540c28c0 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.726+0000 7ffa52ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7ffa540c2ca0 0x7ffa541514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33708/0 (socket says 172.21.15.46:33708) 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.726+0000 7ffa52ffd640 1 -- 172.21.15.46:0/2996814925 learned_addr learned my addr 172.21.15.46:0/2996814925 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:42.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.726+0000 7ffa537fe640 1 --2- 172.21.15.46:0/2996814925 >> v2:172.21.15.78:3300/0 conn(0x7ffa540c28c0 0x7ffa540c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.728+0000 7ffa527fc640 1 -- 172.21.15.46:0/2996814925 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211224058 0 0) 0x7ffa540ccf60 con 0x7ffa540c2ca0 2024-01-27T13:32:42.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.728+0000 7ffa527fc640 1 -- 172.21.15.46:0/2996814925 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa3c003520 con 0x7ffa540c2ca0 2024-01-27T13:32:42.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.729+0000 7ffa537fe640 1 -- 172.21.15.46:0/2996814925 >> v1:172.21.15.78:6789/0 conn(0x7ffa54151c00 legacy=0x7ffa54157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.729+0000 7ffa537fe640 1 -- 172.21.15.46:0/2996814925 >> v1:172.21.15.46:6789/0 conn(0x7ffa540c2ca0 legacy=0x7ffa541514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.729+0000 7ffa537fe640 1 -- 172.21.15.46:0/2996814925 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540cd200 con 0x7ffa540c28c0 2024-01-27T13:32:42.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.734+0000 7ffa537fe640 1 --2- 172.21.15.46:0/2996814925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa540c1cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa440097a0 tx=0x7ffa4402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eecbb1d142e9067 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.738+0000 7ffa527fc640 1 -- 172.21.15.46:0/2996814925 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44030610 con 0x7ffa540c28c0 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.738+0000 7ffa527fc640 1 -- 172.21.15.46:0/2996814925 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44030770 con 0x7ffa540c28c0 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.738+0000 7ffa527fc640 1 -- 172.21.15.46:0/2996814925 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44030b00 con 0x7ffa540c28c0 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 -- 172.21.15.46:0/2996814925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 msgr2=0x7ffa540c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/2996814925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa540c1cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa440097a0 tx=0x7ffa4402b960 comp rx=0 tx=0).stop 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 -- 172.21.15.46:0/2996814925 shutdown_connections 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/2996814925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa540c1cd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 -- 172.21.15.46:0/2996814925 >> 172.21.15.46:0/2996814925 conn(0x7ffa5406efe0 msgr2=0x7ffa5406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:42.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 -- 172.21.15.46:0/2996814925 shutdown_connections 2024-01-27T13:32:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.739+0000 7ffa59f0f640 1 -- 172.21.15.46:0/2996814925 wait complete. 2024-01-27T13:32:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.740+0000 7ffa59f0f640 1 Processor -- start 2024-01-27T13:32:42.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.740+0000 7ffa59f0f640 1 -- start start 2024-01-27T13:32:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa59f0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa5414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa59f0f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa540c2ca0 0x7ffa5414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa59f0f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 0x7ffa5406c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa59f0f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540b2200 con 0x7ffa54151c00 2024-01-27T13:32:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa59f0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541f3e20 con 0x7ffa540c28c0 2024-01-27T13:32:42.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa59f0f640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa541f3270 con 0x7ffa540c2ca0 2024-01-27T13:32:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 0x7ffa5406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa5414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa52ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa540c2ca0 0x7ffa5414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa53fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 0x7ffa5406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50244/0 (socket says 172.21.15.46:50244) 2024-01-27T13:32:42.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.741+0000 7ffa53fff640 1 -- 172.21.15.46:0/3499173219 learned_addr learned my addr 172.21.15.46:0/3499173219 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.745+0000 7ffa53fff640 1 -- 172.21.15.46:0/3499173219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa540c2ca0 msgr2=0x7ffa5414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.745+0000 7ffa53fff640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa540c2ca0 0x7ffa5414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.745+0000 7ffa53fff640 1 -- 172.21.15.46:0/3499173219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 msgr2=0x7ffa5414ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.745+0000 7ffa53fff640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa5414ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:42.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.745+0000 7ffa53fff640 1 -- 172.21.15.46:0/3499173219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44009400 con 0x7ffa54151c00 2024-01-27T13:32:42.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.747+0000 7ffa53fff640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 0x7ffa5406c300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c730 tx=0x7ffa4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:42.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.751+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c003b70 con 0x7ffa54151c00 2024-01-27T13:32:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.751+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c003cd0 con 0x7ffa54151c00 2024-01-27T13:32:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.751+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00aa90 con 0x7ffa54151c00 2024-01-27T13:32:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.751+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540b1f20 con 0x7ffa54151c00 2024-01-27T13:32:42.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.751+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa541f3760 con 0x7ffa54151c00 2024-01-27T13:32:42.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:42.752+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa541f3f60 con 0x7ffa54151c00 2024-01-27T13:32:43.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.017+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ffa4c00abf0 con 0x7ffa54151c00 2024-01-27T13:32:43.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.018+0000 7ffa3bfff640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ffa4006af50 0x7ffa4006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:43.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.018+0000 7ffa537fe640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ffa4006af50 0x7ffa4006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:43.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.018+0000 7ffa537fe640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ffa4006af50 0x7ffa4006d410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa44036000 tx=0x7ffa4403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:43.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.033+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa4c00ce40 con 0x7ffa54151c00 2024-01-27T13:32:43.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.033+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ffa4c054bb0 con 0x7ffa54151c00 2024-01-27T13:32:43.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:43.255+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffa541f3f60 con 0x7ffa54151c00 2024-01-27T13:32:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.184+0000 7ffa3bfff640 1 -- 172.21.15.46:0/3499173219 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffa541f3f60 con 0x7ffa54151c00 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ffa4006af50 msgr2=0x7ffa4006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ffa4006af50 0x7ffa4006d410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffa44036000 tx=0x7ffa4403b040 comp rx=0 tx=0).stop 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 msgr2=0x7ffa5406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 0x7ffa5406c300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c730 tx=0x7ffa4c00cbf0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 shutdown_connections 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ffa4006af50 0x7ffa4006d410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa54151c00 0x7ffa5406c300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ffa540c2ca0 0x7ffa5414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 --2- 172.21.15.46:0/3499173219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffa540c28c0 0x7ffa5414ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 >> 172.21.15.46:0/3499173219 conn(0x7ffa5406efe0 msgr2=0x7ffa5406f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 shutdown_connections 2024-01-27T13:32:44.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.187+0000 7ffa59f0f640 1 -- 172.21.15.46:0/3499173219 wait complete. 2024-01-27T13:32:44.190 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-01-27T13:32:44.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-27T13:32:44.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.304+0000 7f3de7ea4640 1 Processor -- start 2024-01-27T13:32:44.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.304+0000 7f3de7ea4640 1 -- start start 2024-01-27T13:32:44.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.305+0000 7f3de7ea4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3de0070f50 0x7f3de00cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:44.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.305+0000 7f3de7ea4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0071330 0x7f3de00c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:44.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.305+0000 7f3de7ea4640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de0159990 con 0x7f3de01534d0 2024-01-27T13:32:44.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.305+0000 7f3de7ea4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de0159c50 con 0x7f3de0070f50 2024-01-27T13:32:44.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.305+0000 7f3de7ea4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0159f30 con 0x7f3de0071330 2024-01-27T13:32:44.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.306+0000 7f3de6441640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f3de01534d0 0x7f3de006b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:33718/0 (socket says 172.21.15.46:33718) 2024-01-27T13:32:44.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.306+0000 7f3de6441640 1 -- 172.21.15.46:0/2413781074 learned_addr learned my addr 172.21.15.46:0/2413781074 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:44.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.306+0000 7f3de543f640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0071330 0x7f3de00c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:44.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.306+0000 7f3de5c40640 1 --2- 172.21.15.46:0/2413781074 >> v2:172.21.15.78:3300/0 conn(0x7f3de0070f50 0x7f3de00cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:44.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.308+0000 7f3de5c40640 1 -- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0071330 msgr2=0x7f3de00c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:44.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.308+0000 7f3de5c40640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0071330 0x7f3de00c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.308+0000 7f3de5c40640 1 -- 172.21.15.46:0/2413781074 >> v1:172.21.15.46:6789/0 conn(0x7f3de01534d0 legacy=0x7f3de006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:44.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.308+0000 7f3de4c3e640 1 -- 172.21.15.46:0/2413781074 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239464883 0 0) 0x7f3de0159990 con 0x7f3de01534d0 2024-01-27T13:32:44.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.308+0000 7f3de5c40640 1 -- 172.21.15.46:0/2413781074 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de015a210 con 0x7f3de0070f50 2024-01-27T13:32:44.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.308+0000 7f3de543f640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0071330 0x7f3de00c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:44.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.310+0000 7f3de5c40640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de0070f50 0x7f3de00cd990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80097d0 tx=0x7f3dd802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f0278f53ab9b19 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:44.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.314+0000 7f3de4c3e640 1 -- 172.21.15.46:0/2413781074 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8031890 con 0x7f3de0070f50 2024-01-27T13:32:44.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.314+0000 7f3de4c3e640 1 -- 172.21.15.46:0/2413781074 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd80319f0 con 0x7f3de0070f50 2024-01-27T13:32:44.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.314+0000 7f3de4c3e640 1 -- 172.21.15.46:0/2413781074 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8031d80 con 0x7f3de0070f50 2024-01-27T13:32:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 -- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de0070f50 msgr2=0x7f3de00cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de0070f50 0x7f3de00cd990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80097d0 tx=0x7f3dd802b930 comp rx=0 tx=0).stop 2024-01-27T13:32:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 -- 172.21.15.46:0/2413781074 shutdown_connections 2024-01-27T13:32:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0071330 0x7f3de00c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/2413781074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de0070f50 0x7f3de00cd990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 -- 172.21.15.46:0/2413781074 >> 172.21.15.46:0/2413781074 conn(0x7f3de006add0 msgr2=0x7f3de006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:44.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 -- 172.21.15.46:0/2413781074 shutdown_connections 2024-01-27T13:32:44.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.315+0000 7f3de7ea4640 1 -- 172.21.15.46:0/2413781074 wait complete. 2024-01-27T13:32:44.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.316+0000 7f3de7ea4640 1 Processor -- start 2024-01-27T13:32:44.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.316+0000 7f3de7ea4640 1 -- start start 2024-01-27T13:32:44.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de7ea4640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0070f50 0x7f3de01eeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:44.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de7ea4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3de0071330 0x7f3de0159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:44.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de7ea4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de01534d0 0x7f3de01568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de7ea4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01ef080 con 0x7f3de0071330 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de7ea4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00c2fd0 con 0x7f3de01534d0 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de7ea4640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de015c850 con 0x7f3de0070f50 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de543f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3de0071330 0x7f3de0159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de5c40640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0070f50 0x7f3de01eeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de6441640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de01534d0 0x7f3de01568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de543f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3de0071330 0x7f3de0159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50254/0 (socket says 172.21.15.46:50254) 2024-01-27T13:32:44.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.317+0000 7f3de543f640 1 -- 172.21.15.46:0/1849471717 learned_addr learned my addr 172.21.15.46:0/1849471717 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:44.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.321+0000 7f3de5c40640 1 -- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de01534d0 msgr2=0x7f3de01568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:44.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.321+0000 7f3de5c40640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de01534d0 0x7f3de01568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.321+0000 7f3de5c40640 1 -- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3de0071330 msgr2=0x7f3de0159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:44.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.321+0000 7f3de5c40640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3de0071330 0x7f3de0159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:44.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.321+0000 7f3de5c40640 1 -- 172.21.15.46:0/1849471717 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4009400 con 0x7f3de0070f50 2024-01-27T13:32:44.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.323+0000 7f3de5c40640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0070f50 0x7f3de01eeb40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8033000 tx=0x7f3dd80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.327+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd803bd30 con 0x7f3de0070f50 2024-01-27T13:32:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.327+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd80453f0 con 0x7f3de0070f50 2024-01-27T13:32:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.327+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80457a0 con 0x7f3de0070f50 2024-01-27T13:32:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.327+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd8009400 con 0x7f3de0070f50 2024-01-27T13:32:44.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.327+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de01efb00 con 0x7f3de0070f50 2024-01-27T13:32:44.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.328+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de006b650 con 0x7f3de0070f50 2024-01-27T13:32:44.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.346+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3dd804e450 con 0x7f3de0070f50 2024-01-27T13:32:44.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.346+0000 7f3dde7fc640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3dcc06af50 0x7f3dcc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:44.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.346+0000 7f3de543f640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3dcc06af50 0x7f3dcc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:44.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.346+0000 7f3de543f640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3dcc06af50 0x7f3dcc06d410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3de006bdd0 tx=0x7f3dd4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:44.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.349+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3dd807ac00 con 0x7f3de0070f50 2024-01-27T13:32:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.585+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3dd8076f40 con 0x7f3de0070f50 2024-01-27T13:32:44.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:44.802+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3de006c060 con 0x7f3de0070f50 2024-01-27T13:32:45.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.337+0000 7f3dde7fc640 1 -- 172.21.15.46:0/1849471717 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3dd807a560 con 0x7f3de0070f50 2024-01-27T13:32:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3dcc06af50 msgr2=0x7f3dcc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:45.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3dcc06af50 0x7f3dcc06d410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3de006bdd0 tx=0x7f3dd4009190 comp rx=0 tx=0).stop 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0070f50 msgr2=0x7f3de01eeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0070f50 0x7f3de01eeb40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8033000 tx=0x7f3dd80046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 shutdown_connections 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f3dcc06af50 0x7f3dcc06d410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3de01534d0 0x7f3de01568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3de0071330 0x7f3de0159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 --2- 172.21.15.46:0/1849471717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3de0070f50 0x7f3de01eeb40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 >> 172.21.15.46:0/1849471717 conn(0x7f3de006add0 msgr2=0x7f3de00cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 shutdown_connections 2024-01-27T13:32:45.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.339+0000 7f3de7ea4640 1 -- 172.21.15.46:0/1849471717 wait complete. 2024-01-27T13:32:45.342 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-27T13:32:45.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 Processor -- start 2024-01-27T13:32:45.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 -- start start 2024-01-27T13:32:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f984406b820 0x7f984406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f984415d990 0x7f984406c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984406c9a0 con 0x7f98440c7d70 2024-01-27T13:32:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984406c140 con 0x7f984406b820 2024-01-27T13:32:45.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.455+0000 7f984ae9b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984415d500 con 0x7f984415d990 2024-01-27T13:32:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.456+0000 7f9848c37640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f984406b820 0x7f984406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.456+0000 7f9843fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f984415d990 0x7f984406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.456+0000 7f9849438640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f98440c7d70 0x7f9844159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:36686/0 (socket says 172.21.15.46:36686) 2024-01-27T13:32:45.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.456+0000 7f9849438640 1 -- 172.21.15.46:0/3793340696 learned_addr learned my addr 172.21.15.46:0/3793340696 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.459+0000 7f9848c37640 1 -- 172.21.15.46:0/3793340696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f984415d990 msgr2=0x7f984406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.459+0000 7f9848c37640 1 --2- 172.21.15.46:0/3793340696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f984415d990 0x7f984406c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.459+0000 7f9848c37640 1 -- 172.21.15.46:0/3793340696 >> v1:172.21.15.78:6789/0 conn(0x7f98440c7d70 legacy=0x7f9844159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:45.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.459+0000 7f9848c37640 1 -- 172.21.15.46:0/3793340696 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98440c7b50 con 0x7f984406b820 2024-01-27T13:32:45.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.461+0000 7f9848c37640 1 --2- 172.21.15.46:0/3793340696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f984406bc00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed21eb26e74a58d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.464+0000 7f98437fe640 1 -- 172.21.15.46:0/3793340696 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838031830 con 0x7f984406b820 2024-01-27T13:32:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f98437fe640 1 -- 172.21.15.46:0/3793340696 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838031990 con 0x7f984406b820 2024-01-27T13:32:45.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f98437fe640 1 -- 172.21.15.46:0/3793340696 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838031d20 con 0x7f984406b820 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 -- 172.21.15.46:0/3793340696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 msgr2=0x7f984406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 --2- 172.21.15.46:0/3793340696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f984406bc00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 -- 172.21.15.46:0/3793340696 shutdown_connections 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 --2- 172.21.15.46:0/3793340696 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f984415d990 0x7f984406c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 --2- 172.21.15.46:0/3793340696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f984406bc00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 -- 172.21.15.46:0/3793340696 >> 172.21.15.46:0/3793340696 conn(0x7f98440663a0 msgr2=0x7f98440667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 -- 172.21.15.46:0/3793340696 shutdown_connections 2024-01-27T13:32:45.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.465+0000 7f984ae9b640 1 -- 172.21.15.46:0/3793340696 wait complete. 2024-01-27T13:32:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.466+0000 7f984ae9b640 1 Processor -- start 2024-01-27T13:32:45.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.466+0000 7f984ae9b640 1 -- start start 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.467+0000 7f984ae9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f98441ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.467+0000 7f984ae9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f98440c7d70 0x7f98441564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.467+0000 7f984ae9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984415d990 0x7f98441e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.467+0000 7f984ae9b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98441e3bc0 con 0x7f984406b820 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.467+0000 7f984ae9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9844156a10 con 0x7f984415d990 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.467+0000 7f984ae9b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98441e3040 con 0x7f98440c7d70 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.468+0000 7f9848c37640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f98441ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.468+0000 7f9843fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f98440c7d70 0x7f98441564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:45.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.468+0000 7f9849438640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984415d990 0x7f98441e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:45.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.468+0000 7f9848c37640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f98441ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49420/0 (socket says 172.21.15.46:49420) 2024-01-27T13:32:45.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.468+0000 7f9848c37640 1 -- 172.21.15.46:0/1597009554 learned_addr learned my addr 172.21.15.46:0/1597009554 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.471+0000 7f9843fff640 1 -- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984415d990 msgr2=0x7f98441e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.471+0000 7f9843fff640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984415d990 0x7f98441e6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.471+0000 7f9843fff640 1 -- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 msgr2=0x7f98441ef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.471+0000 7f9843fff640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f98441ef7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.471+0000 7f9843fff640 1 -- 172.21.15.46:0/1597009554 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009400 con 0x7f98440c7d70 2024-01-27T13:32:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.473+0000 7f9843fff640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f98440c7d70 0x7f98441564d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f983000e870 tx=0x7f983000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.477+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983000ee60 con 0x7f98440c7d70 2024-01-27T13:32:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.477+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983000c940 con 0x7f98440c7d70 2024-01-27T13:32:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.477+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983000ccd0 con 0x7f98440c7d70 2024-01-27T13:32:45.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.477+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98441e3320 con 0x7f98440c7d70 2024-01-27T13:32:45.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.477+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98441e38e0 con 0x7f98440c7d70 2024-01-27T13:32:45.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.478+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9844153cf0 con 0x7f98440c7d70 2024-01-27T13:32:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.499+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9830013470 con 0x7f98440c7d70 2024-01-27T13:32:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.499+0000 7f98417fa640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f982806af50 0x7f982806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.499+0000 7f9848c37640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f982806af50 0x7f982806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.500+0000 7f9848c37640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f982806af50 0x7f982806d410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f983802b910 tx=0x7f983803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:45.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.725+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f983000ce30 con 0x7f98440c7d70 2024-01-27T13:32:45.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.736+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9830054d20 con 0x7f98440c7d70 2024-01-27T13:32:45.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:45.960+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f9844074410 con 0x7f98440c7d70 2024-01-27T13:32:46.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.357+0000 7f98417fa640 1 -- 172.21.15.46:0/1597009554 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f98300210b0 con 0x7f98440c7d70 2024-01-27T13:32:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f982806af50 msgr2=0x7f982806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f982806af50 0x7f982806d410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f983802b910 tx=0x7f983803c040 comp rx=0 tx=0).stop 2024-01-27T13:32:46.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f98440c7d70 msgr2=0x7f98441564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f98440c7d70 0x7f98441564d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f983000e870 tx=0x7f983000ed30 comp rx=0 tx=0).stop 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 shutdown_connections 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f982806af50 0x7f982806d410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f984415d990 0x7f98441e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f98440c7d70 0x7f98441564d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 --2- 172.21.15.46:0/1597009554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f984406b820 0x7f98441ef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 >> 172.21.15.46:0/1597009554 conn(0x7f98440663a0 msgr2=0x7f98440ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 shutdown_connections 2024-01-27T13:32:46.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.360+0000 7f984ae9b640 1 -- 172.21.15.46:0/1597009554 wait complete. 2024-01-27T13:32:46.363 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-27T13:32:46.363 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:32:46.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.474+0000 7f6dbac31640 1 Processor -- start 2024-01-27T13:32:46.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.474+0000 7f6dbac31640 1 -- start start 2024-01-27T13:32:46.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.475+0000 7f6dbac31640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6db40c77d0 0x7f6db40c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:46.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.475+0000 7f6dbac31640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6db40c8580 0x7f6db4159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:46.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.475+0000 7f6dbac31640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db40c9480 con 0x7f6db4153a50 2024-01-27T13:32:46.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.475+0000 7f6dbac31640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40c9740 con 0x7f6db40c8580 2024-01-27T13:32:46.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.475+0000 7f6dbac31640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db40c9290 con 0x7f6db40c77d0 2024-01-27T13:32:46.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.475+0000 7f6db91ce640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6db40c8580 0x7f6db4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:46.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.476+0000 7f6db89cd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6db4153a50 0x7f6db40c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40328/0 (socket says 172.21.15.46:40328) 2024-01-27T13:32:46.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.476+0000 7f6db89cd640 1 -- 172.21.15.46:0/2082004896 learned_addr learned my addr 172.21.15.46:0/2082004896 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:46.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.476+0000 7f6db3fff640 1 --2- 172.21.15.46:0/2082004896 >> v2:172.21.15.78:3300/0 conn(0x7f6db40c77d0 0x7f6db40c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:46.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.478+0000 7f6db3fff640 1 -- 172.21.15.46:0/2082004896 >> v2:172.21.15.46:3300/0 conn(0x7f6db40c8580 msgr2=0x7f6db4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:46.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.478+0000 7f6db3fff640 1 --2- 172.21.15.46:0/2082004896 >> v2:172.21.15.46:3300/0 conn(0x7f6db40c8580 0x7f6db4159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.478+0000 7f6db3fff640 1 -- 172.21.15.46:0/2082004896 >> v1:172.21.15.46:6789/0 conn(0x7f6db4153a50 legacy=0x7f6db40c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:46.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.478+0000 7f6db3fff640 1 -- 172.21.15.46:0/2082004896 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db406bfb0 con 0x7f6db40c77d0 2024-01-27T13:32:46.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.480+0000 7f6db3fff640 1 --2- 172.21.15.46:0/2082004896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db40c8040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6db40c4120 tx=0x7f6da002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58c13962887395d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6db37fe640 1 -- 172.21.15.46:0/2082004896 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0030610 con 0x7f6db40c77d0 2024-01-27T13:32:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6db37fe640 1 -- 172.21.15.46:0/2082004896 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da0030770 con 0x7f6db40c77d0 2024-01-27T13:32:46.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6db37fe640 1 -- 172.21.15.46:0/2082004896 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0030b00 con 0x7f6db40c77d0 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6dbac31640 1 -- 172.21.15.46:0/2082004896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 msgr2=0x7f6db40c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6dbac31640 1 --2- 172.21.15.46:0/2082004896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db40c8040 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6db40c4120 tx=0x7f6da002b960 comp rx=0 tx=0).stop 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6dbac31640 1 -- 172.21.15.46:0/2082004896 shutdown_connections 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6dbac31640 1 --2- 172.21.15.46:0/2082004896 >> v2:172.21.15.46:3300/0 conn(0x7f6db40c8580 0x7f6db4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6dbac31640 1 --2- 172.21.15.46:0/2082004896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db40c8040 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.484+0000 7f6dbac31640 1 -- 172.21.15.46:0/2082004896 >> 172.21.15.46:0/2082004896 conn(0x7f6db406efe0 msgr2=0x7f6db406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.485+0000 7f6dbac31640 1 -- 172.21.15.46:0/2082004896 shutdown_connections 2024-01-27T13:32:46.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.485+0000 7f6dbac31640 1 -- 172.21.15.46:0/2082004896 wait complete. 2024-01-27T13:32:46.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 Processor -- start 2024-01-27T13:32:46.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 -- start start 2024-01-27T13:32:46.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:46.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6db40c8580 0x7f6db4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:46.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6db4153a50 0x7f6db41ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:46.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4156ce0 con 0x7f6db40c8580 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db41f2910 con 0x7f6db40c77d0 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.486+0000 7f6dbac31640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4156540 con 0x7f6db4153a50 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.487+0000 7f6db3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6db40c8580 0x7f6db4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.487+0000 7f6db89cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.487+0000 7f6db91ce640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6db4153a50 0x7f6db41ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.487+0000 7f6db3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6db40c8580 0x7f6db4154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49446/0 (socket says 172.21.15.46:49446) 2024-01-27T13:32:46.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.487+0000 7f6db3fff640 1 -- 172.21.15.46:0/3597555093 learned_addr learned my addr 172.21.15.46:0/3597555093 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:46.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.490+0000 7f6db89cd640 1 -- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6db4153a50 msgr2=0x7f6db41ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:46.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.490+0000 7f6db89cd640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6db4153a50 0x7f6db41ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.490+0000 7f6db89cd640 1 -- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6db40c8580 msgr2=0x7f6db4154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:46.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.490+0000 7f6db89cd640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6db40c8580 0x7f6db4154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:46.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.491+0000 7f6db89cd640 1 -- 172.21.15.46:0/3597555093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da0009400 con 0x7f6db40c77d0 2024-01-27T13:32:46.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.493+0000 7f6db89cd640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db4151510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c370 tx=0x7f6da800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:46.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.496+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8005ce0 con 0x7f6db40c77d0 2024-01-27T13:32:46.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.496+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8005e40 con 0x7f6db40c77d0 2024-01-27T13:32:46.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.496+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8007310 con 0x7f6db40c77d0 2024-01-27T13:32:46.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.496+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db41f2b20 con 0x7f6db40c77d0 2024-01-27T13:32:46.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.496+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db41f30e0 con 0x7f6db40c77d0 2024-01-27T13:32:46.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.497+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db406c550 con 0x7f6db40c77d0 2024-01-27T13:32:46.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.515+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6da8007470 con 0x7f6db40c77d0 2024-01-27T13:32:46.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.515+0000 7f6db17fa640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6d9806af50 0x7f6d9806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:46.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.515+0000 7f6db3fff640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6d9806af50 0x7f6d9806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:46.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.515+0000 7f6db3fff640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6d9806af50 0x7f6d9806d410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6db40cd270 tx=0x7f6da003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:46.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.518+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6da8007720 con 0x7f6db40c77d0 2024-01-27T13:32:46.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.755+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6da8053d90 con 0x7f6db40c77d0 2024-01-27T13:32:46.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:46.975+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6db406c550 con 0x7f6db40c77d0 2024-01-27T13:32:47.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.063+0000 7f6db17fa640 1 -- 172.21.15.46:0/3597555093 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6514 (secure 0 0 0) 0x7f6db406c550 con 0x7f6db40c77d0 2024-01-27T13:32:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:47.056 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:45.974762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T13:32:47.057 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6d9806af50 msgr2=0x7f6d9806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6d9806af50 0x7f6d9806d410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6db40cd270 tx=0x7f6da003b040 comp rx=0 tx=0).stop 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 msgr2=0x7f6db4151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db4151510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c370 tx=0x7f6da800c830 comp rx=0 tx=0).stop 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 shutdown_connections 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6d9806af50 0x7f6d9806d410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6db4153a50 0x7f6db41ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6db40c8580 0x7f6db4154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 --2- 172.21.15.46:0/3597555093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6db40c77d0 0x7f6db4151510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.065+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 >> 172.21.15.46:0/3597555093 conn(0x7f6db406efe0 msgr2=0x7f6db40c8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.066+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 shutdown_connections 2024-01-27T13:32:47.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.066+0000 7f6dbac31640 1 -- 172.21.15.46:0/3597555093 wait complete. 2024-01-27T13:32:47.070 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:47.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.178+0000 7efc4641e640 1 Processor -- start 2024-01-27T13:32:47.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.178+0000 7efc4641e640 1 -- start start 2024-01-27T13:32:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.179+0000 7efc4641e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7efc40153a70 0x7efc400c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.179+0000 7efc4641e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc4006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.179+0000 7efc4641e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc400c3f90 con 0x7efc4015ce20 2024-01-27T13:32:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.179+0000 7efc4641e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4006c060 con 0x7efc40153a70 2024-01-27T13:32:47.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.179+0000 7efc4641e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400670d0 con 0x7efc4006c4f0 2024-01-27T13:32:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.180+0000 7efc3f7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc4006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.180+0000 7efc449bb640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efc4015ce20 0x7efc4015d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40334/0 (socket says 172.21.15.46:40334) 2024-01-27T13:32:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.180+0000 7efc449bb640 1 -- 172.21.15.46:0/3132706194 learned_addr learned my addr 172.21.15.46:0/3132706194 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:47.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.180+0000 7efc3ffff640 1 --2- 172.21.15.46:0/3132706194 >> v2:172.21.15.46:3300/0 conn(0x7efc40153a70 0x7efc400c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.182+0000 7efc3f7fe640 1 -- 172.21.15.46:0/3132706194 >> v2:172.21.15.46:3300/0 conn(0x7efc40153a70 msgr2=0x7efc400c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:47.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.182+0000 7efc3f7fe640 1 --2- 172.21.15.46:0/3132706194 >> v2:172.21.15.46:3300/0 conn(0x7efc40153a70 0x7efc400c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.182+0000 7efc3f7fe640 1 -- 172.21.15.46:0/3132706194 >> v1:172.21.15.46:6789/0 conn(0x7efc4015ce20 legacy=0x7efc4015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.182+0000 7efc3f7fe640 1 -- 172.21.15.46:0/3132706194 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400cac10 con 0x7efc4006c4f0 2024-01-27T13:32:47.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.185+0000 7efc3f7fe640 1 --2- 172.21.15.46:0/3132706194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc4006c910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc280097a0 tx=0x7efc2802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67420d94a63e5c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.188+0000 7efc3effd640 1 -- 172.21.15.46:0/3132706194 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2802e070 con 0x7efc4006c4f0 2024-01-27T13:32:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.188+0000 7efc3effd640 1 -- 172.21.15.46:0/3132706194 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc280315a0 con 0x7efc4006c4f0 2024-01-27T13:32:47.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.188+0000 7efc3effd640 1 -- 172.21.15.46:0/3132706194 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28031930 con 0x7efc4006c4f0 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 -- 172.21.15.46:0/3132706194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 msgr2=0x7efc4006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 --2- 172.21.15.46:0/3132706194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc4006c910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc280097a0 tx=0x7efc2802b840 comp rx=0 tx=0).stop 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 -- 172.21.15.46:0/3132706194 shutdown_connections 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 --2- 172.21.15.46:0/3132706194 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc4006c910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 --2- 172.21.15.46:0/3132706194 >> v2:172.21.15.46:3300/0 conn(0x7efc40153a70 0x7efc400c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 -- 172.21.15.46:0/3132706194 >> 172.21.15.46:0/3132706194 conn(0x7efc4008b600 msgr2=0x7efc400663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 -- 172.21.15.46:0/3132706194 shutdown_connections 2024-01-27T13:32:47.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.189+0000 7efc4641e640 1 -- 172.21.15.46:0/3132706194 wait complete. 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.190+0000 7efc4641e640 1 Processor -- start 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.190+0000 7efc4641e640 1 -- start start 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc4641e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc400b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc4641e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 0x7efc4015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc4641e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015ce20 0x7efc40149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc4641e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc401eff20 con 0x7efc40153a70 2024-01-27T13:32:47.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc4641e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4014c190 con 0x7efc4015ce20 2024-01-27T13:32:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc4641e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400b3d80 con 0x7efc4006c4f0 2024-01-27T13:32:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.191+0000 7efc3f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 0x7efc4015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.192+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc400b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.192+0000 7efc449bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015ce20 0x7efc40149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.192+0000 7efc3f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 0x7efc4015c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49466/0 (socket says 172.21.15.46:49466) 2024-01-27T13:32:47.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.192+0000 7efc3f7fe640 1 -- 172.21.15.46:0/4278823384 learned_addr learned my addr 172.21.15.46:0/4278823384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.195+0000 7efc3f7fe640 1 -- 172.21.15.46:0/4278823384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 msgr2=0x7efc400b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.195+0000 7efc3f7fe640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc400b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.195+0000 7efc3f7fe640 1 -- 172.21.15.46:0/4278823384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015ce20 msgr2=0x7efc40149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.195+0000 7efc3f7fe640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015ce20 0x7efc40149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.195+0000 7efc3f7fe640 1 -- 172.21.15.46:0/4278823384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28009400 con 0x7efc40153a70 2024-01-27T13:32:47.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.197+0000 7efc3f7fe640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 0x7efc4015c3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc28034040 tx=0x7efc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:47.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.201+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28032900 con 0x7efc40153a70 2024-01-27T13:32:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.201+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28032a80 con 0x7efc40153a70 2024-01-27T13:32:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.201+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28032e30 con 0x7efc40153a70 2024-01-27T13:32:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.201+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc401ef610 con 0x7efc40153a70 2024-01-27T13:32:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.201+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc401ef8d0 con 0x7efc40153a70 2024-01-27T13:32:47.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.202+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc40067330 con 0x7efc40153a70 2024-01-27T13:32:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.221+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efc2804e430 con 0x7efc40153a70 2024-01-27T13:32:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.222+0000 7efc3cff9640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efc2006af20 0x7efc2006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.222+0000 7efc3ffff640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efc2006af20 0x7efc2006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.222+0000 7efc3ffff640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efc2006af20 0x7efc2006d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc300079a0 tx=0x7efc30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:47.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.224+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efc2807a450 con 0x7efc40153a70 2024-01-27T13:32:47.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.475+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efc28076790 con 0x7efc40153a70 2024-01-27T13:32:47.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.663+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc40074410 con 0x7efc40153a70 2024-01-27T13:32:47.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.703+0000 7efc3cff9640 1 -- 172.21.15.46:0/4278823384 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18311 (secure 0 0 0) 0x7efc28079db0 con 0x7efc40153a70 2024-01-27T13:32:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:47.696 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:18.707866+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efc2006af20 msgr2=0x7efc2006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efc2006af20 0x7efc2006d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc300079a0 tx=0x7efc30008040 comp rx=0 tx=0).stop 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 msgr2=0x7efc4015c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 0x7efc4015c3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc28034040 tx=0x7efc280046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 shutdown_connections 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efc2006af20 0x7efc2006d3e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc4015ce20 0x7efc40149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc40153a70 0x7efc4015c3d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 --2- 172.21.15.46:0/4278823384 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efc4006c4f0 0x7efc400b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 >> 172.21.15.46:0/4278823384 conn(0x7efc4008b600 msgr2=0x7efc40152290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 shutdown_connections 2024-01-27T13:32:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.705+0000 7efc4641e640 1 -- 172.21.15.46:0/4278823384 wait complete. 2024-01-27T13:32:47.709 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-27T13:32:47.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T13:32:47.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.818+0000 7f1f7667c640 1 Processor -- start 2024-01-27T13:32:47.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.818+0000 7f1f7667c640 1 -- start start 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.819+0000 7f1f7667c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f70153a90 0x7f1f700c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.819+0000 7f1f7667c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f700c5840 0x7f1f7015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.819+0000 7f1f7667c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f70066a00 con 0x7f1f700c7c80 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.819+0000 7f1f7667c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f70072c20 con 0x7f1f700c5840 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.819+0000 7f1f7667c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700c38b0 con 0x7f1f70153a90 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.819+0000 7f1f6f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1f700c5840 0x7f1f7015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.820+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f70153a90 0x7f1f700c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.820+0000 7f1f74c19640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1f700c7c80 0x7f1f7015d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:36694/0 (socket says 172.21.15.46:36694) 2024-01-27T13:32:47.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.820+0000 7f1f74c19640 1 -- 172.21.15.46:0/3690059329 learned_addr learned my addr 172.21.15.46:0/3690059329 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:47.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.822+0000 7f1f6f7fe640 1 -- 172.21.15.46:0/3690059329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f70153a90 msgr2=0x7f1f700c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:47.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.822+0000 7f1f6f7fe640 1 --2- 172.21.15.46:0/3690059329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f70153a90 0x7f1f700c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.822+0000 7f1f6f7fe640 1 -- 172.21.15.46:0/3690059329 >> v1:172.21.15.78:6789/0 conn(0x7f1f700c7c80 legacy=0x7f1f7015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.822+0000 7f1f6f7fe640 1 -- 172.21.15.46:0/3690059329 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70066440 con 0x7f1f700c5840 2024-01-27T13:32:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.824+0000 7f1f6f7fe640 1 --2- 172.21.15.46:0/3690059329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f700c5840 0x7f1f7015cdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097d0 tx=0x7f1f6002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749c999357dc9eff server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.827+0000 7f1f6effd640 1 -- 172.21.15.46:0/3690059329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60031800 con 0x7f1f700c5840 2024-01-27T13:32:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.827+0000 7f1f6effd640 1 -- 172.21.15.46:0/3690059329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f60031960 con 0x7f1f700c5840 2024-01-27T13:32:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.827+0000 7f1f6effd640 1 -- 172.21.15.46:0/3690059329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60031cf0 con 0x7f1f700c5840 2024-01-27T13:32:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 -- 172.21.15.46:0/3690059329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f700c5840 msgr2=0x7f1f7015cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 --2- 172.21.15.46:0/3690059329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f700c5840 0x7f1f7015cdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097d0 tx=0x7f1f6002b8a0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 -- 172.21.15.46:0/3690059329 shutdown_connections 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 --2- 172.21.15.46:0/3690059329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f700c5840 0x7f1f7015cdb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 --2- 172.21.15.46:0/3690059329 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f70153a90 0x7f1f700c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 -- 172.21.15.46:0/3690059329 >> 172.21.15.46:0/3690059329 conn(0x7f1f70071980 msgr2=0x7f1f70071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 -- 172.21.15.46:0/3690059329 shutdown_connections 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.828+0000 7f1f7667c640 1 -- 172.21.15.46:0/3690059329 wait complete. 2024-01-27T13:32:47.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.829+0000 7f1f7667c640 1 Processor -- start 2024-01-27T13:32:47.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 -- start start 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f700c5840 0x7f1f7014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f700c7c80 0x7f1f7014b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 0x7f1f701f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7014cdb0 con 0x7f1f70153a90 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70158d20 con 0x7f1f700c7c80 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.830+0000 7f1f7667c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7014c7f0 con 0x7f1f700c5840 2024-01-27T13:32:47.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.831+0000 7f1f74c19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 0x7f1f701f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.831+0000 7f1f6f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f700c7c80 0x7f1f7014b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.831+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f700c5840 0x7f1f7014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.831+0000 7f1f74c19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 0x7f1f701f2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49492/0 (socket says 172.21.15.46:49492) 2024-01-27T13:32:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.831+0000 7f1f74c19640 1 -- 172.21.15.46:0/4168302605 learned_addr learned my addr 172.21.15.46:0/4168302605 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.834+0000 7f1f74c19640 1 -- 172.21.15.46:0/4168302605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f700c5840 msgr2=0x7f1f7014c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.834+0000 7f1f74c19640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f700c5840 0x7f1f7014c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.834+0000 7f1f74c19640 1 -- 172.21.15.46:0/4168302605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f700c7c80 msgr2=0x7f1f7014b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:47.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.834+0000 7f1f74c19640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f700c7c80 0x7f1f7014b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.834+0000 7f1f74c19640 1 -- 172.21.15.46:0/4168302605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60009400 con 0x7f1f70153a90 2024-01-27T13:32:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.837+0000 7f1f74c19640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 0x7f1f701f2570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800cb10 tx=0x7f1f6800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.840+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6800ac70 con 0x7f1f70153a90 2024-01-27T13:32:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.840+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6800add0 con 0x7f1f70153a90 2024-01-27T13:32:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.840+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f68012600 con 0x7f1f70153a90 2024-01-27T13:32:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.840+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7014cad0 con 0x7f1f70153a90 2024-01-27T13:32:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.840+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7014a070 con 0x7f1f70153a90 2024-01-27T13:32:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:47.841+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70149bf0 con 0x7f1f70153a90 2024-01-27T13:32:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.102+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1f68007070 con 0x7f1f70153a90 2024-01-27T13:32:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.102+0000 7f1f6cff9640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f5c06af20 0x7f1f5c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.103+0000 7f1f6ffff640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f5c06af20 0x7f1f5c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.103+0000 7f1f6ffff640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f5c06af20 0x7f1f5c06d3e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009aa0 tx=0x7f1f64009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.116+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f680584a0 con 0x7f1f70153a90 2024-01-27T13:32:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.116+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1f680547e0 con 0x7f1f70153a90 2024-01-27T13:32:48.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.292+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f700728b0 con 0x7f1f5c06af20 2024-01-27T13:32:48.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.301+0000 7f1f6cff9640 1 -- 172.21.15.46:0/4168302605 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345269 (secure 0 0 0) 0x7f1f64011a00 con 0x7f1f5c06af20 2024-01-27T13:32:48.299 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:48.301 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T13:32:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f5c06af20 msgr2=0x7f1f5c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f5c06af20 0x7f1f5c06d3e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009aa0 tx=0x7f1f64009190 comp rx=0 tx=0).stop 2024-01-27T13:32:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 msgr2=0x7f1f701f2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 0x7f1f701f2570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800cb10 tx=0x7f1f6800a060 comp rx=0 tx=0).stop 2024-01-27T13:32:48.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 shutdown_connections 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f5c06af20 0x7f1f5c06d3e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f70153a90 0x7f1f701f2570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f700c7c80 0x7f1f7014b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 --2- 172.21.15.46:0/4168302605 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1f700c5840 0x7f1f7014c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.304+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 >> 172.21.15.46:0/4168302605 conn(0x7f1f70071980 msgr2=0x7f1f70151980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.305+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 shutdown_connections 2024-01-27T13:32:48.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.305+0000 7f1f7667c640 1 -- 172.21.15.46:0/4168302605 wait complete. 2024-01-27T13:32:48.307 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-01-27T13:32:47.583426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235004,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739716,"statfs":{"total":773094113280,"available":772853469184,"internally_reserved":0,"allocated":2260992,"data_stored":2008454,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121373+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:32:19.121373+0000","last_peered":"2024-01-27T13:32:19.121373+0000","last_clean":"2024-01-27T13:32:19.121373+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:32:19.121373+0000","last_undegraded":"2024-01-27T13:32:19.121373+0000","last_fullsized":"2024-01-27T13:32:19.121373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068649+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T13:32:20.068649+0000","last_peered":"2024-01-27T13:32:20.068649+0000","last_clean":"2024-01-27T13:32:20.068649+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T13:32:20.068649+0000","last_undegraded":"2024-01-27T13:32:20.068649+0000","last_fullsized":"2024-01-27T13:32:20.068649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067376+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:32:20.067376+0000","last_peered":"2024-01-27T13:32:20.067376+0000","last_clean":"2024-01-27T13:32:20.067376+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:32:20.067376+0000","last_undegraded":"2024-01-27T13:32:20.067376+0000","last_fullsized":"2024-01-27T13:32:20.067376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068808+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:32:20.068808+0000","last_peered":"2024-01-27T13:32:20.068808+0000","last_clean":"2024-01-27T13:32:20.068808+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:32:20.068808+0000","last_undegraded":"2024-01-27T13:32:20.068808+0000","last_fullsized":"2024-01-27T13:32:20.068808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121133+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T13:32:19.121133+0000","last_peered":"2024-01-27T13:32:19.121133+0000","last_clean":"2024-01-27T13:32:19.121133+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T13:32:19.121133+0000","last_undegraded":"2024-01-27T13:32:19.121133+0000","last_fullsized":"2024-01-27T13:32:19.121133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126573+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:32:19.126573+0000","last_peered":"2024-01-27T13:32:19.126573+0000","last_clean":"2024-01-27T13:32:19.126573+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:32:19.126573+0000","last_undegraded":"2024-01-27T13:32:19.126573+0000","last_fullsized":"2024-01-27T13:32:19.126573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068211+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:32:20.068211+0000","last_peered":"2024-01-27T13:32:20.068211+0000","last_clean":"2024-01-27T13:32:20.068211+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:32:20.068211+0000","last_undegraded":"2024-01-27T13:32:20.068211+0000","last_fullsized":"2024-01-27T13:32:20.068211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136113+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T13:32:19.136113+0000","last_peered":"2024-01-27T13:32:19.136113+0000","last_clean":"2024-01-27T13:32:19.136113+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T13:32:19.136113+0000","last_undegraded":"2024-01-27T13:32:19.136113+0000","last_fullsized":"2024-01-27T13:32:19.136113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126882+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:32:19.126882+0000","last_peered":"2024-01-27T13:32:19.126882+0000","last_clean":"2024-01-27T13:32:19.126882+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:32:19.126882+0000","last_undegraded":"2024-01-27T13:32:19.126882+0000","last_fullsized":"2024-01-27T13:32:19.126882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067851+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:32:20.067851+0000","last_peered":"2024-01-27T13:32:20.067851+0000","last_clean":"2024-01-27T13:32:20.067851+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:32:20.067851+0000","last_undegraded":"2024-01-27T13:32:20.067851+0000","last_fullsized":"2024-01-27T13:32:20.067851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136359+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T13:32:19.136359+0000","last_peered":"2024-01-27T13:32:19.136359+0000","last_clean":"2024-01-27T13:32:19.136359+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T13:32:19.136359+0000","last_undegraded":"2024-01-27T13:32:19.136359+0000","last_fullsized":"2024-01-27T13:32:19.136359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126753+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:32:19.126753+0000","last_peered":"2024-01-27T13:32:19.126753+0000","last_clean":"2024-01-27T13:32:19.126753+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:32:19.126753+0000","last_undegraded":"2024-01-27T13:32:19.126753+0000","last_fullsized":"2024-01-27T13:32:19.126753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068389+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T13:32:20.068389+0000","last_peered":"2024-01-27T13:32:20.068389+0000","last_clean":"2024-01-27T13:32:20.068389+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T13:32:20.068389+0000","last_undegraded":"2024-01-27T13:32:20.068389+0000","last_fullsized":"2024-01-27T13:32:20.068389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068256+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:32:20.068256+0000","last_peered":"2024-01-27T13:32:20.068256+0000","last_clean":"2024-01-27T13:32:20.068256+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:32:20.068256+0000","last_undegraded":"2024-01-27T13:32:20.068256+0000","last_fullsized":"2024-01-27T13:32:20.068256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126917+0000","last_change":"2024-01-27T13:32:18.089623+0000","last_active":"2024-01-27T13:32:19.126917+0000","last_peered":"2024-01-27T13:32:19.126917+0000","last_clean":"2024-01-27T13:32:19.126917+0000","last_became_active":"2024-01-27T13:32:18.089293+0000","last_became_peered":"2024-01-27T13:32:18.089293+0000","last_unstale":"2024-01-27T13:32:19.126917+0000","last_undegraded":"2024-01-27T13:32:19.126917+0000","last_fullsized":"2024-01-27T13:32:19.126917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:09:14.847454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068742+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T13:32:20.068742+0000","last_peered":"2024-01-27T13:32:20.068742+0000","last_clean":"2024-01-27T13:32:20.068742+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T13:32:20.068742+0000","last_undegraded":"2024-01-27T13:32:20.068742+0000","last_fullsized":"2024-01-27T13:32:20.068742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068343+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:32:20.068343+0000","last_peered":"2024-01-27T13:32:20.068343+0000","last_clean":"2024-01-27T13:32:20.068343+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:32:20.068343+0000","last_undegraded":"2024-01-27T13:32:20.068343+0000","last_fullsized":"2024-01-27T13:32:20.068343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126918+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:32:19.126918+0000","last_peered":"2024-01-27T13:32:19.126918+0000","last_clean":"2024-01-27T13:32:19.126918+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:32:19.126918+0000","last_undegraded":"2024-01-27T13:32:19.126918+0000","last_fullsized":"2024-01-27T13:32:19.126918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067535+0000","last_change":"2024-01-27T13:32:13.633359+0000","last_active":"2024-01-27T13:32:20.067535+0000","last_peered":"2024-01-27T13:32:20.067535+0000","last_clean":"2024-01-27T13:32:20.067535+0000","last_became_active":"2024-01-27T13:32:13.632583+0000","last_became_peered":"2024-01-27T13:32:13.632583+0000","last_unstale":"2024-01-27T13:32:20.067535+0000","last_undegraded":"2024-01-27T13:32:20.067535+0000","last_fullsized":"2024-01-27T13:32:20.067535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067987+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:32:20.067987+0000","last_peered":"2024-01-27T13:32:20.067987+0000","last_clean":"2024-01-27T13:32:20.067987+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:32:20.067987+0000","last_undegraded":"2024-01-27T13:32:20.067987+0000","last_fullsized":"2024-01-27T13:32:20.067987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068554+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:32:20.068554+0000","last_peered":"2024-01-27T13:32:20.068554+0000","last_clean":"2024-01-27T13:32:20.068554+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:32:20.068554+0000","last_undegraded":"2024-01-27T13:32:20.068554+0000","last_fullsized":"2024-01-27T13:32:20.068554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127286+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:32:19.127286+0000","last_peered":"2024-01-27T13:32:19.127286+0000","last_clean":"2024-01-27T13:32:19.127286+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:32:19.127286+0000","last_undegraded":"2024-01-27T13:32:19.127286+0000","last_fullsized":"2024-01-27T13:32:19.127286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067511+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:32:20.067511+0000","last_peered":"2024-01-27T13:32:20.067511+0000","last_clean":"2024-01-27T13:32:20.067511+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:32:20.067511+0000","last_undegraded":"2024-01-27T13:32:20.067511+0000","last_fullsized":"2024-01-27T13:32:20.067511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127020+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:32:19.127020+0000","last_peered":"2024-01-27T13:32:19.127020+0000","last_clean":"2024-01-27T13:32:19.127020+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:32:19.127020+0000","last_undegraded":"2024-01-27T13:32:19.127020+0000","last_fullsized":"2024-01-27T13:32:19.127020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121405+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T13:32:19.121405+0000","last_peered":"2024-01-27T13:32:19.121405+0000","last_clean":"2024-01-27T13:32:19.121405+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T13:32:19.121405+0000","last_undegraded":"2024-01-27T13:32:19.121405+0000","last_fullsized":"2024-01-27T13:32:19.121405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068552+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:32:20.068552+0000","last_peered":"2024-01-27T13:32:20.068552+0000","last_clean":"2024-01-27T13:32:20.068552+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:32:20.068552+0000","last_undegraded":"2024-01-27T13:32:20.068552+0000","last_fullsized":"2024-01-27T13:32:20.068552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126776+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:32:19.126776+0000","last_peered":"2024-01-27T13:32:19.126776+0000","last_clean":"2024-01-27T13:32:19.126776+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:32:19.126776+0000","last_undegraded":"2024-01-27T13:32:19.126776+0000","last_fullsized":"2024-01-27T13:32:19.126776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068982+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T13:32:20.068982+0000","last_peered":"2024-01-27T13:32:20.068982+0000","last_clean":"2024-01-27T13:32:20.068982+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T13:32:20.068982+0000","last_undegraded":"2024-01-27T13:32:20.068982+0000","last_fullsized":"2024-01-27T13:32:20.068982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068533+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:32:20.068533+0000","last_peered":"2024-01-27T13:32:20.068533+0000","last_clean":"2024-01-27T13:32:20.068533+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:32:20.068533+0000","last_undegraded":"2024-01-27T13:32:20.068533+0000","last_fullsized":"2024-01-27T13:32:20.068533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067308+0000","last_change":"2024-01-27T13:32:18.347860+0000","last_active":"2024-01-27T13:32:20.067308+0000","last_peered":"2024-01-27T13:32:20.067308+0000","last_clean":"2024-01-27T13:32:20.067308+0000","last_became_active":"2024-01-27T13:32:18.347450+0000","last_became_peered":"2024-01-27T13:32:18.347450+0000","last_unstale":"2024-01-27T13:32:20.067308+0000","last_undegraded":"2024-01-27T13:32:20.067308+0000","last_fullsized":"2024-01-27T13:32:20.067308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068489+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T13:32:20.068489+0000","last_peered":"2024-01-27T13:32:20.068489+0000","last_clean":"2024-01-27T13:32:20.068489+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T13:32:20.068489+0000","last_undegraded":"2024-01-27T13:32:20.068489+0000","last_fullsized":"2024-01-27T13:32:20.068489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068378+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:32:20.068378+0000","last_peered":"2024-01-27T13:32:20.068378+0000","last_clean":"2024-01-27T13:32:20.068378+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:32:20.068378+0000","last_undegraded":"2024-01-27T13:32:20.068378+0000","last_fullsized":"2024-01-27T13:32:20.068378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121336+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:32:19.121336+0000","last_peered":"2024-01-27T13:32:19.121336+0000","last_clean":"2024-01-27T13:32:19.121336+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:32:19.121336+0000","last_undegraded":"2024-01-27T13:32:19.121336+0000","last_fullsized":"2024-01-27T13:32:19.121336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136462+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T13:32:19.136462+0000","last_peered":"2024-01-27T13:32:19.136462+0000","last_clean":"2024-01-27T13:32:19.136462+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T13:32:19.136462+0000","last_undegraded":"2024-01-27T13:32:19.136462+0000","last_fullsized":"2024-01-27T13:32:19.136462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068630+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:32:20.068630+0000","last_peered":"2024-01-27T13:32:20.068630+0000","last_clean":"2024-01-27T13:32:20.068630+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:32:20.068630+0000","last_undegraded":"2024-01-27T13:32:20.068630+0000","last_fullsized":"2024-01-27T13:32:20.068630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068322+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:32:20.068322+0000","last_peered":"2024-01-27T13:32:20.068322+0000","last_clean":"2024-01-27T13:32:20.068322+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:32:20.068322+0000","last_undegraded":"2024-01-27T13:32:20.068322+0000","last_fullsized":"2024-01-27T13:32:20.068322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127309+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T13:32:19.127309+0000","last_peered":"2024-01-27T13:32:19.127309+0000","last_clean":"2024-01-27T13:32:19.127309+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T13:32:19.127309+0000","last_undegraded":"2024-01-27T13:32:19.127309+0000","last_fullsized":"2024-01-27T13:32:19.127309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136304+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:32:19.136304+0000","last_peered":"2024-01-27T13:32:19.136304+0000","last_clean":"2024-01-27T13:32:19.136304+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:32:19.136304+0000","last_undegraded":"2024-01-27T13:32:19.136304+0000","last_fullsized":"2024-01-27T13:32:19.136304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068226+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:32:20.068226+0000","last_peered":"2024-01-27T13:32:20.068226+0000","last_clean":"2024-01-27T13:32:20.068226+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:32:20.068226+0000","last_undegraded":"2024-01-27T13:32:20.068226+0000","last_fullsized":"2024-01-27T13:32:20.068226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067668+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T13:32:20.067668+0000","last_peered":"2024-01-27T13:32:20.067668+0000","last_clean":"2024-01-27T13:32:20.067668+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T13:32:20.067668+0000","last_undegraded":"2024-01-27T13:32:20.067668+0000","last_fullsized":"2024-01-27T13:32:20.067668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821068+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T13:32:19.821068+0000","last_peered":"2024-01-27T13:32:19.821068+0000","last_clean":"2024-01-27T13:32:19.821068+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T13:32:19.821068+0000","last_undegraded":"2024-01-27T13:32:19.821068+0000","last_fullsized":"2024-01-27T13:32:19.821068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068619+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:32:20.068619+0000","last_peered":"2024-01-27T13:32:20.068619+0000","last_clean":"2024-01-27T13:32:20.068619+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:32:20.068619+0000","last_undegraded":"2024-01-27T13:32:20.068619+0000","last_fullsized":"2024-01-27T13:32:20.068619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.120856+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T13:32:19.120856+0000","last_peered":"2024-01-27T13:32:19.120856+0000","last_clean":"2024-01-27T13:32:19.120856+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T13:32:19.120856+0000","last_undegraded":"2024-01-27T13:32:19.120856+0000","last_fullsized":"2024-01-27T13:32:19.120856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067610+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T13:32:20.067610+0000","last_peered":"2024-01-27T13:32:20.067610+0000","last_clean":"2024-01-27T13:32:20.067610+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T13:32:20.067610+0000","last_undegraded":"2024-01-27T13:32:20.067610+0000","last_fullsized":"2024-01-27T13:32:20.067610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121399+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:32:19.121399+0000","last_peered":"2024-01-27T13:32:19.121399+0000","last_clean":"2024-01-27T13:32:19.121399+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:32:19.121399+0000","last_undegraded":"2024-01-27T13:32:19.121399+0000","last_fullsized":"2024-01-27T13:32:19.121399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067670+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T13:32:20.067670+0000","last_peered":"2024-01-27T13:32:20.067670+0000","last_clean":"2024-01-27T13:32:20.067670+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T13:32:20.067670+0000","last_undegraded":"2024-01-27T13:32:20.067670+0000","last_fullsized":"2024-01-27T13:32:20.067670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136077+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:32:19.136077+0000","last_peered":"2024-01-27T13:32:19.136077+0000","last_clean":"2024-01-27T13:32:19.136077+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:32:19.136077+0000","last_undegraded":"2024-01-27T13:32:19.136077+0000","last_fullsized":"2024-01-27T13:32:19.136077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067799+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:32:20.067799+0000","last_peered":"2024-01-27T13:32:20.067799+0000","last_clean":"2024-01-27T13:32:20.067799+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:32:20.067799+0000","last_undegraded":"2024-01-27T13:32:20.067799+0000","last_fullsized":"2024-01-27T13:32:20.067799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068032+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:32:20.068032+0000","last_peered":"2024-01-27T13:32:20.068032+0000","last_clean":"2024-01-27T13:32:20.068032+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:32:20.068032+0000","last_undegraded":"2024-01-27T13:32:20.068032+0000","last_fullsized":"2024-01-27T13:32:20.068032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068100+0000","last_change":"2024-01-27T13:32:13.603513+0000","last_active":"2024-01-27T13:32:20.068100+0000","last_peered":"2024-01-27T13:32:20.068100+0000","last_clean":"2024-01-27T13:32:20.068100+0000","last_became_active":"2024-01-27T13:32:13.603259+0000","last_became_peered":"2024-01-27T13:32:13.603259+0000","last_unstale":"2024-01-27T13:32:20.068100+0000","last_undegraded":"2024-01-27T13:32:20.068100+0000","last_fullsized":"2024-01-27T13:32:20.068100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:09:10.194290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821270+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:32:19.821270+0000","last_peered":"2024-01-27T13:32:19.821270+0000","last_clean":"2024-01-27T13:32:19.821270+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:32:19.821270+0000","last_undegraded":"2024-01-27T13:32:19.821270+0000","last_fullsized":"2024-01-27T13:32:19.821270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067552+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:32:20.067552+0000","last_peered":"2024-01-27T13:32:20.067552+0000","last_clean":"2024-01-27T13:32:20.067552+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:32:20.067552+0000","last_undegraded":"2024-01-27T13:32:20.067552+0000","last_fullsized":"2024-01-27T13:32:20.067552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136152+0000","last_change":"2024-01-27T13:32:13.637629+0000","last_active":"2024-01-27T13:32:19.136152+0000","last_peered":"2024-01-27T13:32:19.136152+0000","last_clean":"2024-01-27T13:32:19.136152+0000","last_became_active":"2024-01-27T13:32:13.637056+0000","last_became_peered":"2024-01-27T13:32:13.637056+0000","last_unstale":"2024-01-27T13:32:19.136152+0000","last_undegraded":"2024-01-27T13:32:19.136152+0000","last_fullsized":"2024-01-27T13:32:19.136152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068363+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:32:20.068363+0000","last_peered":"2024-01-27T13:32:20.068363+0000","last_clean":"2024-01-27T13:32:20.068363+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:32:20.068363+0000","last_undegraded":"2024-01-27T13:32:20.068363+0000","last_fullsized":"2024-01-27T13:32:20.068363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121499+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:32:19.121499+0000","last_peered":"2024-01-27T13:32:19.121499+0000","last_clean":"2024-01-27T13:32:19.121499+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:32:19.121499+0000","last_undegraded":"2024-01-27T13:32:19.121499+0000","last_fullsized":"2024-01-27T13:32:19.121499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068279+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T13:32:20.068279+0000","last_peered":"2024-01-27T13:32:20.068279+0000","last_clean":"2024-01-27T13:32:20.068279+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T13:32:20.068279+0000","last_undegraded":"2024-01-27T13:32:20.068279+0000","last_fullsized":"2024-01-27T13:32:20.068279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821363+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:32:19.821363+0000","last_peered":"2024-01-27T13:32:19.821363+0000","last_clean":"2024-01-27T13:32:19.821363+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:32:19.821363+0000","last_undegraded":"2024-01-27T13:32:19.821363+0000","last_fullsized":"2024-01-27T13:32:19.821363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.135827+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:32:19.135827+0000","last_peered":"2024-01-27T13:32:19.135827+0000","last_clean":"2024-01-27T13:32:19.135827+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:32:19.135827+0000","last_undegraded":"2024-01-27T13:32:19.135827+0000","last_fullsized":"2024-01-27T13:32:19.135827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068014+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T13:32:20.068014+0000","last_peered":"2024-01-27T13:32:20.068014+0000","last_clean":"2024-01-27T13:32:20.068014+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T13:32:20.068014+0000","last_undegraded":"2024-01-27T13:32:20.068014+0000","last_fullsized":"2024-01-27T13:32:20.068014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127235+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:32:19.127235+0000","last_peered":"2024-01-27T13:32:19.127235+0000","last_clean":"2024-01-27T13:32:19.127235+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:32:19.127235+0000","last_undegraded":"2024-01-27T13:32:19.127235+0000","last_fullsized":"2024-01-27T13:32:19.127235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126869+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:32:19.126869+0000","last_peered":"2024-01-27T13:32:19.126869+0000","last_clean":"2024-01-27T13:32:19.126869+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:32:19.126869+0000","last_undegraded":"2024-01-27T13:32:19.126869+0000","last_fullsized":"2024-01-27T13:32:19.126869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067625+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T13:32:20.067625+0000","last_peered":"2024-01-27T13:32:20.067625+0000","last_clean":"2024-01-27T13:32:20.067625+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T13:32:20.067625+0000","last_undegraded":"2024-01-27T13:32:20.067625+0000","last_fullsized":"2024-01-27T13:32:20.067625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.820964+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:32:19.820964+0000","last_peered":"2024-01-27T13:32:19.820964+0000","last_clean":"2024-01-27T13:32:19.820964+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:32:19.820964+0000","last_undegraded":"2024-01-27T13:32:19.820964+0000","last_fullsized":"2024-01-27T13:32:19.820964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121189+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:32:19.121189+0000","last_peered":"2024-01-27T13:32:19.121189+0000","last_clean":"2024-01-27T13:32:19.121189+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:32:19.121189+0000","last_undegraded":"2024-01-27T13:32:19.121189+0000","last_fullsized":"2024-01-27T13:32:19.121189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067558+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T13:32:20.067558+0000","last_peered":"2024-01-27T13:32:20.067558+0000","last_clean":"2024-01-27T13:32:20.067558+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T13:32:20.067558+0000","last_undegraded":"2024-01-27T13:32:20.067558+0000","last_fullsized":"2024-01-27T13:32:20.067558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067722+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:32:20.067722+0000","last_peered":"2024-01-27T13:32:20.067722+0000","last_clean":"2024-01-27T13:32:20.067722+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:32:20.067722+0000","last_undegraded":"2024-01-27T13:32:20.067722+0000","last_fullsized":"2024-01-27T13:32:20.067722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068948+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:32:20.068948+0000","last_peered":"2024-01-27T13:32:20.068948+0000","last_clean":"2024-01-27T13:32:20.068948+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:32:20.068948+0000","last_undegraded":"2024-01-27T13:32:20.068948+0000","last_fullsized":"2024-01-27T13:32:20.068948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068089+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T13:32:20.068089+0000","last_peered":"2024-01-27T13:32:20.068089+0000","last_clean":"2024-01-27T13:32:20.068089+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T13:32:20.068089+0000","last_undegraded":"2024-01-27T13:32:20.068089+0000","last_fullsized":"2024-01-27T13:32:20.068089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136201+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:32:19.136201+0000","last_peered":"2024-01-27T13:32:19.136201+0000","last_clean":"2024-01-27T13:32:19.136201+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:32:19.136201+0000","last_undegraded":"2024-01-27T13:32:19.136201+0000","last_fullsized":"2024-01-27T13:32:19.136201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068043+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:32:20.068043+0000","last_peered":"2024-01-27T13:32:20.068043+0000","last_clean":"2024-01-27T13:32:20.068043+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:32:20.068043+0000","last_undegraded":"2024-01-27T13:32:20.068043+0000","last_fullsized":"2024-01-27T13:32:20.068043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121092+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T13:32:19.121092+0000","last_peered":"2024-01-27T13:32:19.121092+0000","last_clean":"2024-01-27T13:32:19.121092+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T13:32:19.121092+0000","last_undegraded":"2024-01-27T13:32:19.121092+0000","last_fullsized":"2024-01-27T13:32:19.121092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121569+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:32:19.121569+0000","last_peered":"2024-01-27T13:32:19.121569+0000","last_clean":"2024-01-27T13:32:19.121569+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:32:19.121569+0000","last_undegraded":"2024-01-27T13:32:19.121569+0000","last_fullsized":"2024-01-27T13:32:19.121569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136376+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:32:19.136376+0000","last_peered":"2024-01-27T13:32:19.136376+0000","last_clean":"2024-01-27T13:32:19.136376+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:32:19.136376+0000","last_undegraded":"2024-01-27T13:32:19.136376+0000","last_fullsized":"2024-01-27T13:32:19.136376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068015+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T13:32:20.068015+0000","last_peered":"2024-01-27T13:32:20.068015+0000","last_clean":"2024-01-27T13:32:20.068015+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T13:32:20.068015+0000","last_undegraded":"2024-01-27T13:32:20.068015+0000","last_fullsized":"2024-01-27T13:32:20.068015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:35.150945+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:32:35.150945+0000","last_peered":"2024-01-27T13:32:35.150945+0000","last_clean":"2024-01-27T13:32:35.150945+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:32:35.150945+0000","last_undegraded":"2024-01-27T13:32:35.150945+0000","last_fullsized":"2024-01-27T13:32:35.150945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068123+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:32:20.068123+0000","last_peered":"2024-01-27T13:32:20.068123+0000","last_clean":"2024-01-27T13:32:20.068123+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:32:20.068123+0000","last_undegraded":"2024-01-27T13:32:20.068123+0000","last_fullsized":"2024-01-27T13:32:20.068123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127159+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T13:32:19.127159+0000","last_peered":"2024-01-27T13:32:19.127159+0000","last_clean":"2024-01-27T13:32:19.127159+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T13:32:19.127159+0000","last_undegraded":"2024-01-27T13:32:19.127159+0000","last_fullsized":"2024-01-27T13:32:19.127159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068260+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:32:20.068260+0000","last_peered":"2024-01-27T13:32:20.068260+0000","last_clean":"2024-01-27T13:32:20.068260+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:32:20.068260+0000","last_undegraded":"2024-01-27T13:32:20.068260+0000","last_fullsized":"2024-01-27T13:32:20.068260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127333+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:32:19.127333+0000","last_peered":"2024-01-27T13:32:19.127333+0000","last_clean":"2024-01-27T13:32:19.127333+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:32:19.127333+0000","last_undegraded":"2024-01-27T13:32:19.127333+0000","last_fullsized":"2024-01-27T13:32:19.127333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121228+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T13:32:19.121228+0000","last_peered":"2024-01-27T13:32:19.121228+0000","last_clean":"2024-01-27T13:32:19.121228+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T13:32:19.121228+0000","last_undegraded":"2024-01-27T13:32:19.121228+0000","last_fullsized":"2024-01-27T13:32:19.121228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136268+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:32:19.136268+0000","last_peered":"2024-01-27T13:32:19.136268+0000","last_clean":"2024-01-27T13:32:19.136268+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:32:19.136268+0000","last_undegraded":"2024-01-27T13:32:19.136268+0000","last_fullsized":"2024-01-27T13:32:19.136268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067455+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:32:20.067455+0000","last_peered":"2024-01-27T13:32:20.067455+0000","last_clean":"2024-01-27T13:32:20.067455+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:32:20.067455+0000","last_undegraded":"2024-01-27T13:32:20.067455+0000","last_fullsized":"2024-01-27T13:32:20.067455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136194+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T13:32:19.136194+0000","last_peered":"2024-01-27T13:32:19.136194+0000","last_clean":"2024-01-27T13:32:19.136194+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T13:32:19.136194+0000","last_undegraded":"2024-01-27T13:32:19.136194+0000","last_fullsized":"2024-01-27T13:32:19.136194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068465+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:32:20.068465+0000","last_peered":"2024-01-27T13:32:20.068465+0000","last_clean":"2024-01-27T13:32:20.068465+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:32:20.068465+0000","last_undegraded":"2024-01-27T13:32:20.068465+0000","last_fullsized":"2024-01-27T13:32:20.068465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067433+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:32:20.067433+0000","last_peered":"2024-01-27T13:32:20.067433+0000","last_clean":"2024-01-27T13:32:20.067433+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:32:20.067433+0000","last_undegraded":"2024-01-27T13:32:20.067433+0000","last_fullsized":"2024-01-27T13:32:20.067433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121117+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:32:19.121117+0000","last_peered":"2024-01-27T13:32:19.121117+0000","last_clean":"2024-01-27T13:32:19.121117+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:32:19.121117+0000","last_undegraded":"2024-01-27T13:32:19.121117+0000","last_fullsized":"2024-01-27T13:32:19.121117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067772+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T13:32:20.067772+0000","last_peered":"2024-01-27T13:32:20.067772+0000","last_clean":"2024-01-27T13:32:20.067772+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T13:32:20.067772+0000","last_undegraded":"2024-01-27T13:32:20.067772+0000","last_fullsized":"2024-01-27T13:32:20.067772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136233+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:32:19.136233+0000","last_peered":"2024-01-27T13:32:19.136233+0000","last_clean":"2024-01-27T13:32:19.136233+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:32:19.136233+0000","last_undegraded":"2024-01-27T13:32:19.136233+0000","last_fullsized":"2024-01-27T13:32:19.136233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068328+0000","last_change":"2024-01-27T13:32:18.071494+0000","last_active":"2024-01-27T13:32:20.068328+0000","last_peered":"2024-01-27T13:32:20.068328+0000","last_clean":"2024-01-27T13:32:20.068328+0000","last_became_active":"2024-01-27T13:32:18.071206+0000","last_became_peered":"2024-01-27T13:32:18.071206+0000","last_unstale":"2024-01-27T13:32:20.068328+0000","last_undegraded":"2024-01-27T13:32:20.068328+0000","last_fullsized":"2024-01-27T13:32:20.068328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067463+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T13:32:20.067463+0000","last_peered":"2024-01-27T13:32:20.067463+0000","last_clean":"2024-01-27T13:32:20.067463+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T13:32:20.067463+0000","last_undegraded":"2024-01-27T13:32:20.067463+0000","last_fullsized":"2024-01-27T13:32:20.067463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067725+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:32:20.067725+0000","last_peered":"2024-01-27T13:32:20.067725+0000","last_clean":"2024-01-27T13:32:20.067725+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:32:20.067725+0000","last_undegraded":"2024-01-27T13:32:20.067725+0000","last_fullsized":"2024-01-27T13:32:20.067725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068470+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:32:20.068470+0000","last_peered":"2024-01-27T13:32:20.068470+0000","last_clean":"2024-01-27T13:32:20.068470+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:32:20.068470+0000","last_undegraded":"2024-01-27T13:32:20.068470+0000","last_fullsized":"2024-01-27T13:32:20.068470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121540+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T13:32:19.121540+0000","last_peered":"2024-01-27T13:32:19.121540+0000","last_clean":"2024-01-27T13:32:19.121540+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T13:32:19.121540+0000","last_undegraded":"2024-01-27T13:32:19.121540+0000","last_fullsized":"2024-01-27T13:32:19.121540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821168+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:32:19.821168+0000","last_peered":"2024-01-27T13:32:19.821168+0000","last_clean":"2024-01-27T13:32:19.821168+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:32:19.821168+0000","last_undegraded":"2024-01-27T13:32:19.821168+0000","last_fullsized":"2024-01-27T13:32:19.821168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068819+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:32:20.068819+0000","last_peered":"2024-01-27T13:32:20.068819+0000","last_clean":"2024-01-27T13:32:20.068819+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:32:20.068819+0000","last_undegraded":"2024-01-27T13:32:20.068819+0000","last_fullsized":"2024-01-27T13:32:20.068819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126962+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T13:32:19.126962+0000","last_peered":"2024-01-27T13:32:19.126962+0000","last_clean":"2024-01-27T13:32:19.126962+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T13:32:19.126962+0000","last_undegraded":"2024-01-27T13:32:19.126962+0000","last_fullsized":"2024-01-27T13:32:19.126962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068089+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:32:20.068089+0000","last_peered":"2024-01-27T13:32:20.068089+0000","last_clean":"2024-01-27T13:32:20.068089+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:32:20.068089+0000","last_undegraded":"2024-01-27T13:32:20.068089+0000","last_fullsized":"2024-01-27T13:32:20.068089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067695+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T13:32:20.067695+0000","last_peered":"2024-01-27T13:32:20.067695+0000","last_clean":"2024-01-27T13:32:20.067695+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T13:32:20.067695+0000","last_undegraded":"2024-01-27T13:32:20.067695+0000","last_fullsized":"2024-01-27T13:32:20.067695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821170+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T13:32:19.821170+0000","last_peered":"2024-01-27T13:32:19.821170+0000","last_clean":"2024-01-27T13:32:19.821170+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T13:32:19.821170+0000","last_undegraded":"2024-01-27T13:32:19.821170+0000","last_fullsized":"2024-01-27T13:32:19.821170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136100+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T13:32:19.136100+0000","last_peered":"2024-01-27T13:32:19.136100+0000","last_clean":"2024-01-27T13:32:19.136100+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T13:32:19.136100+0000","last_undegraded":"2024-01-27T13:32:19.136100+0000","last_fullsized":"2024-01-27T13:32:19.136100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121447+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T13:32:19.121447+0000","last_peered":"2024-01-27T13:32:19.121447+0000","last_clean":"2024-01-27T13:32:19.121447+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T13:32:19.121447+0000","last_undegraded":"2024-01-27T13:32:19.121447+0000","last_fullsized":"2024-01-27T13:32:19.121447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068353+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T13:32:20.068353+0000","last_peered":"2024-01-27T13:32:20.068353+0000","last_clean":"2024-01-27T13:32:20.068353+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T13:32:20.068353+0000","last_undegraded":"2024-01-27T13:32:20.068353+0000","last_fullsized":"2024-01-27T13:32:20.068353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068094+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T13:32:20.068094+0000","last_peered":"2024-01-27T13:32:20.068094+0000","last_clean":"2024-01-27T13:32:20.068094+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T13:32:20.068094+0000","last_undegraded":"2024-01-27T13:32:20.068094+0000","last_fullsized":"2024-01-27T13:32:20.068094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068034+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T13:32:20.068034+0000","last_peered":"2024-01-27T13:32:20.068034+0000","last_clean":"2024-01-27T13:32:20.068034+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T13:32:20.068034+0000","last_undegraded":"2024-01-27T13:32:20.068034+0000","last_fullsized":"2024-01-27T13:32:20.068034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068936+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T13:32:20.068936+0000","last_peered":"2024-01-27T13:32:20.068936+0000","last_clean":"2024-01-27T13:32:20.068936+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T13:32:20.068936+0000","last_undegraded":"2024-01-27T13:32:20.068936+0000","last_fullsized":"2024-01-27T13:32:20.068936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136098+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T13:32:19.136098+0000","last_peered":"2024-01-27T13:32:19.136098+0000","last_clean":"2024-01-27T13:32:19.136098+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T13:32:19.136098+0000","last_undegraded":"2024-01-27T13:32:19.136098+0000","last_fullsized":"2024-01-27T13:32:19.136098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067631+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T13:32:20.067631+0000","last_peered":"2024-01-27T13:32:20.067631+0000","last_clean":"2024-01-27T13:32:20.067631+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T13:32:20.067631+0000","last_undegraded":"2024-01-27T13:32:20.067631+0000","last_fullsized":"2024-01-27T13:32:20.067631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136091+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T13:32:19.136091+0000","last_peered":"2024-01-27T13:32:19.136091+0000","last_clean":"2024-01-27T13:32:19.136091+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T13:32:19.136091+0000","last_undegraded":"2024-01-27T13:32:19.136091+0000","last_fullsized":"2024-01-27T13:32:19.136091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121319+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T13:32:19.121319+0000","last_peered":"2024-01-27T13:32:19.121319+0000","last_clean":"2024-01-27T13:32:19.121319+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T13:32:19.121319+0000","last_undegraded":"2024-01-27T13:32:19.121319+0000","last_fullsized":"2024-01-27T13:32:19.121319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067920+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T13:32:20.067920+0000","last_peered":"2024-01-27T13:32:20.067920+0000","last_clean":"2024-01-27T13:32:20.067920+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T13:32:20.067920+0000","last_undegraded":"2024-01-27T13:32:20.067920+0000","last_fullsized":"2024-01-27T13:32:20.067920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068300+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T13:32:20.068300+0000","last_peered":"2024-01-27T13:32:20.068300+0000","last_clean":"2024-01-27T13:32:20.068300+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T13:32:20.068300+0000","last_undegraded":"2024-01-27T13:32:20.068300+0000","last_fullsized":"2024-01-27T13:32:20.068300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821300+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T13:32:19.821300+0000","last_peered":"2024-01-27T13:32:19.821300+0000","last_clean":"2024-01-27T13:32:19.821300+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T13:32:19.821300+0000","last_undegraded":"2024-01-27T13:32:19.821300+0000","last_fullsized":"2024-01-27T13:32:19.821300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136451+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T13:32:19.136451+0000","last_peered":"2024-01-27T13:32:19.136451+0000","last_clean":"2024-01-27T13:32:19.136451+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T13:32:19.136451+0000","last_undegraded":"2024-01-27T13:32:19.136451+0000","last_fullsized":"2024-01-27T13:32:19.136451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.135829+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T13:32:19.135829+0000","last_peered":"2024-01-27T13:32:19.135829+0000","last_clean":"2024-01-27T13:32:19.135829+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T13:32:19.135829+0000","last_undegraded":"2024-01-27T13:32:19.135829+0000","last_fullsized":"2024-01-27T13:32:19.135829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067886+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T13:32:20.067886+0000","last_peered":"2024-01-27T13:32:20.067886+0000","last_clean":"2024-01-27T13:32:20.067886+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T13:32:20.067886+0000","last_undegraded":"2024-01-27T13:32:20.067886+0000","last_fullsized":"2024-01-27T13:32:20.067886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121022+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T13:32:19.121022+0000","last_peered":"2024-01-27T13:32:19.121022+0000","last_clean":"2024-01-27T13:32:19.121022+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T13:32:19.121022+0000","last_undegraded":"2024-01-27T13:32:19.121022+0000","last_fullsized":"2024-01-27T13:32:19.121022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068645+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T13:32:20.068645+0000","last_peered":"2024-01-27T13:32:20.068645+0000","last_clean":"2024-01-27T13:32:20.068645+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T13:32:20.068645+0000","last_undegraded":"2024-01-27T13:32:20.068645+0000","last_fullsized":"2024-01-27T13:32:20.068645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127140+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T13:32:19.127140+0000","last_peered":"2024-01-27T13:32:19.127140+0000","last_clean":"2024-01-27T13:32:19.127140+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T13:32:19.127140+0000","last_undegraded":"2024-01-27T13:32:19.127140+0000","last_fullsized":"2024-01-27T13:32:19.127140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068128+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T13:32:20.068128+0000","last_peered":"2024-01-27T13:32:20.068128+0000","last_clean":"2024-01-27T13:32:20.068128+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T13:32:20.068128+0000","last_undegraded":"2024-01-27T13:32:20.068128+0000","last_fullsized":"2024-01-27T13:32:20.068128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068230+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T13:32:20.068230+0000","last_peered":"2024-01-27T13:32:20.068230+0000","last_clean":"2024-01-27T13:32:20.068230+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T13:32:20.068230+0000","last_undegraded":"2024-01-27T13:32:20.068230+0000","last_fullsized":"2024-01-27T13:32:20.068230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068260+0000","last_change":"2024-01-27T13:32:13.603424+0000","last_active":"2024-01-27T13:32:20.068260+0000","last_peered":"2024-01-27T13:32:20.068260+0000","last_clean":"2024-01-27T13:32:20.068260+0000","last_became_active":"2024-01-27T13:32:13.603168+0000","last_became_peered":"2024-01-27T13:32:13.603168+0000","last_unstale":"2024-01-27T13:32:20.068260+0000","last_undegraded":"2024-01-27T13:32:20.068260+0000","last_fullsized":"2024-01-27T13:32:20.068260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:00.668769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067374+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T13:32:20.067374+0000","last_peered":"2024-01-27T13:32:20.067374+0000","last_clean":"2024-01-27T13:32:20.067374+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T13:32:20.067374+0000","last_undegraded":"2024-01-27T13:32:20.067374+0000","last_fullsized":"2024-01-27T13:32:20.067374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067607+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T13:32:20.067607+0000","last_peered":"2024-01-27T13:32:20.067607+0000","last_clean":"2024-01-27T13:32:20.067607+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T13:32:20.067607+0000","last_undegraded":"2024-01-27T13:32:20.067607+0000","last_fullsized":"2024-01-27T13:32:20.067607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136005+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T13:32:19.136005+0000","last_peered":"2024-01-27T13:32:19.136005+0000","last_clean":"2024-01-27T13:32:19.136005+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T13:32:19.136005+0000","last_undegraded":"2024-01-27T13:32:19.136005+0000","last_fullsized":"2024-01-27T13:32:19.136005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067900+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T13:32:20.067900+0000","last_peered":"2024-01-27T13:32:20.067900+0000","last_clean":"2024-01-27T13:32:20.067900+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T13:32:20.067900+0000","last_undegraded":"2024-01-27T13:32:20.067900+0000","last_fullsized":"2024-01-27T13:32:20.067900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136052+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T13:32:19.136052+0000","last_peered":"2024-01-27T13:32:19.136052+0000","last_clean":"2024-01-27T13:32:19.136052+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T13:32:19.136052+0000","last_undegraded":"2024-01-27T13:32:19.136052+0000","last_fullsized":"2024-01-27T13:32:19.136052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121020+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T13:32:19.121020+0000","last_peered":"2024-01-27T13:32:19.121020+0000","last_clean":"2024-01-27T13:32:19.121020+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T13:32:19.121020+0000","last_undegraded":"2024-01-27T13:32:19.121020+0000","last_fullsized":"2024-01-27T13:32:19.121020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068287+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T13:32:20.068287+0000","last_peered":"2024-01-27T13:32:20.068287+0000","last_clean":"2024-01-27T13:32:20.068287+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T13:32:20.068287+0000","last_undegraded":"2024-01-27T13:32:20.068287+0000","last_fullsized":"2024-01-27T13:32:20.068287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068123+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T13:32:20.068123+0000","last_peered":"2024-01-27T13:32:20.068123+0000","last_clean":"2024-01-27T13:32:20.068123+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T13:32:20.068123+0000","last_undegraded":"2024-01-27T13:32:20.068123+0000","last_fullsized":"2024-01-27T13:32:20.068123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":106146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":102305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":102465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":693255,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":102395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":102431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":693311,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T13:32:48.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T13:32:48.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.457+0000 7ff38de9b640 1 Processor -- start 2024-01-27T13:32:48.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.457+0000 7ff38de9b640 1 -- start start 2024-01-27T13:32:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff38de9b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3881598e0 0x7ff3880c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff38de9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff38806ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff38de9b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3880c7620 con 0x7ff388153b80 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff38de9b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3880c67b0 con 0x7ff3881598e0 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff38de9b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880ca180 con 0x7ff3880c8010 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff386ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3881598e0 0x7ff3880c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff387fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff38806ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff386ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff3881598e0 0x7ff3880c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49504/0 (socket says 172.21.15.46:49504) 2024-01-27T13:32:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.458+0000 7ff386ffd640 1 -- 172.21.15.46:0/2349944839 learned_addr learned my addr 172.21.15.46:0/2349944839 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.461+0000 7ff386ffd640 1 -- 172.21.15.46:0/2349944839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 msgr2=0x7ff38806ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.461+0000 7ff386ffd640 1 --2- 172.21.15.46:0/2349944839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff38806ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.461+0000 7ff386ffd640 1 -- 172.21.15.46:0/2349944839 >> v1:172.21.15.78:6789/0 conn(0x7ff388153b80 legacy=0x7ff3880c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.461+0000 7ff386ffd640 1 -- 172.21.15.46:0/2349944839 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880ca460 con 0x7ff3881598e0 2024-01-27T13:32:48.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.463+0000 7ff386ffd640 1 --2- 172.21.15.46:0/2349944839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff3880c7ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff378009870 tx=0x7ff37802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13af90f187ebd027 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:48.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.466+0000 7ff3867fc640 1 -- 172.21.15.46:0/2349944839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378031640 con 0x7ff3881598e0 2024-01-27T13:32:48.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff3867fc640 1 -- 172.21.15.46:0/2349944839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3780317a0 con 0x7ff3881598e0 2024-01-27T13:32:48.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff3867fc640 1 -- 172.21.15.46:0/2349944839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378031b30 con 0x7ff3881598e0 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 -- 172.21.15.46:0/2349944839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 msgr2=0x7ff3880c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 --2- 172.21.15.46:0/2349944839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff3880c7ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff378009870 tx=0x7ff37802b8f0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 -- 172.21.15.46:0/2349944839 shutdown_connections 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 --2- 172.21.15.46:0/2349944839 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff38806ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 --2- 172.21.15.46:0/2349944839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff3880c7ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 -- 172.21.15.46:0/2349944839 >> 172.21.15.46:0/2349944839 conn(0x7ff3880cf230 msgr2=0x7ff3880cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 -- 172.21.15.46:0/2349944839 shutdown_connections 2024-01-27T13:32:48.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.467+0000 7ff38de9b640 1 -- 172.21.15.46:0/2349944839 wait complete. 2024-01-27T13:32:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.468+0000 7ff38de9b640 1 Processor -- start 2024-01-27T13:32:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 -- start start 2024-01-27T13:32:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff388152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff388153b80 0x7ff3880c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff38814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388152a20 con 0x7ff3881598e0 2024-01-27T13:32:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881f0990 con 0x7ff388153b80 2024-01-27T13:32:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.469+0000 7ff38de9b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff388152740 con 0x7ff3880c8010 2024-01-27T13:32:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.470+0000 7ff387fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff38814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.470+0000 7ff386ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff388153b80 0x7ff3880c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.470+0000 7ff387fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff38814fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49510/0 (socket says 172.21.15.46:49510) 2024-01-27T13:32:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.470+0000 7ff387fff640 1 -- 172.21.15.46:0/1984088559 learned_addr learned my addr 172.21.15.46:0/1984088559 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.470+0000 7ff3877fe640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff388152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.473+0000 7ff387fff640 1 -- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 msgr2=0x7ff388152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.473+0000 7ff387fff640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff388152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.473+0000 7ff387fff640 1 -- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff388153b80 msgr2=0x7ff3880c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.473+0000 7ff387fff640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff388153b80 0x7ff3880c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.473+0000 7ff387fff640 1 -- 172.21.15.46:0/1984088559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780094d0 con 0x7ff3881598e0 2024-01-27T13:32:48.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.476+0000 7ff387fff640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff38814fb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff38000efc0 tx=0x7ff38000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.480+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380014480 con 0x7ff3881598e0 2024-01-27T13:32:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.480+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000f040 con 0x7ff3881598e0 2024-01-27T13:32:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.480+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380014820 con 0x7ff3881598e0 2024-01-27T13:32:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.480+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3881efbd0 con 0x7ff3881598e0 2024-01-27T13:32:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.480+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3881f0190 con 0x7ff3881598e0 2024-01-27T13:32:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.481+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388074410 con 0x7ff3881598e0 2024-01-27T13:32:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.747+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff380014980 con 0x7ff3881598e0 2024-01-27T13:32:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.747+0000 7ff36ffff640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff37406af50 0x7ff37406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.748+0000 7ff3877fe640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff37406af50 0x7ff37406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:48.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.748+0000 7ff3877fe640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff37406af50 0x7ff37406d410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001780 tx=0x7ff37c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:48.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.762+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff380059440 con 0x7ff3881598e0 2024-01-27T13:32:48.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.762+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff380055780 con 0x7ff3881598e0 2024-01-27T13:32:48.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.943+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3880cad00 con 0x7ff37406af50 2024-01-27T13:32:48.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.951+0000 7ff36ffff640 1 -- 172.21.15.46:0/1984088559 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345269 (secure 0 0 0) 0x7ff37c001420 con 0x7ff37406af50 2024-01-27T13:32:48.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:48.949 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff37406af50 msgr2=0x7ff37406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff37406af50 0x7ff37406d410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001780 tx=0x7ff37c009040 comp rx=0 tx=0).stop 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 msgr2=0x7ff38814fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff38814fb20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff38000efc0 tx=0x7ff38000c490 comp rx=0 tx=0).stop 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 shutdown_connections 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff37406af50 0x7ff37406d410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3881598e0 0x7ff38814fb20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff388153b80 0x7ff3880c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.956+0000 7ff38de9b640 1 --2- 172.21.15.46:0/1984088559 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff3880c8010 0x7ff388152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:48.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.957+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 >> 172.21.15.46:0/1984088559 conn(0x7ff3880cf230 msgr2=0x7ff388159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:48.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.957+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 shutdown_connections 2024-01-27T13:32:48.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:48.957+0000 7ff38de9b640 1 -- 172.21.15.46:0/1984088559 wait complete. 2024-01-27T13:32:48.960 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-01-27T13:32:47.583426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235004,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739716,"statfs":{"total":773094113280,"available":772853469184,"internally_reserved":0,"allocated":2260992,"data_stored":2008454,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121373+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:32:19.121373+0000","last_peered":"2024-01-27T13:32:19.121373+0000","last_clean":"2024-01-27T13:32:19.121373+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:32:19.121373+0000","last_undegraded":"2024-01-27T13:32:19.121373+0000","last_fullsized":"2024-01-27T13:32:19.121373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068649+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T13:32:20.068649+0000","last_peered":"2024-01-27T13:32:20.068649+0000","last_clean":"2024-01-27T13:32:20.068649+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T13:32:20.068649+0000","last_undegraded":"2024-01-27T13:32:20.068649+0000","last_fullsized":"2024-01-27T13:32:20.068649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067376+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:32:20.067376+0000","last_peered":"2024-01-27T13:32:20.067376+0000","last_clean":"2024-01-27T13:32:20.067376+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:32:20.067376+0000","last_undegraded":"2024-01-27T13:32:20.067376+0000","last_fullsized":"2024-01-27T13:32:20.067376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068808+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:32:20.068808+0000","last_peered":"2024-01-27T13:32:20.068808+0000","last_clean":"2024-01-27T13:32:20.068808+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:32:20.068808+0000","last_undegraded":"2024-01-27T13:32:20.068808+0000","last_fullsized":"2024-01-27T13:32:20.068808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121133+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T13:32:19.121133+0000","last_peered":"2024-01-27T13:32:19.121133+0000","last_clean":"2024-01-27T13:32:19.121133+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T13:32:19.121133+0000","last_undegraded":"2024-01-27T13:32:19.121133+0000","last_fullsized":"2024-01-27T13:32:19.121133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126573+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:32:19.126573+0000","last_peered":"2024-01-27T13:32:19.126573+0000","last_clean":"2024-01-27T13:32:19.126573+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:32:19.126573+0000","last_undegraded":"2024-01-27T13:32:19.126573+0000","last_fullsized":"2024-01-27T13:32:19.126573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068211+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:32:20.068211+0000","last_peered":"2024-01-27T13:32:20.068211+0000","last_clean":"2024-01-27T13:32:20.068211+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:32:20.068211+0000","last_undegraded":"2024-01-27T13:32:20.068211+0000","last_fullsized":"2024-01-27T13:32:20.068211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136113+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T13:32:19.136113+0000","last_peered":"2024-01-27T13:32:19.136113+0000","last_clean":"2024-01-27T13:32:19.136113+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T13:32:19.136113+0000","last_undegraded":"2024-01-27T13:32:19.136113+0000","last_fullsized":"2024-01-27T13:32:19.136113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126882+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:32:19.126882+0000","last_peered":"2024-01-27T13:32:19.126882+0000","last_clean":"2024-01-27T13:32:19.126882+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:32:19.126882+0000","last_undegraded":"2024-01-27T13:32:19.126882+0000","last_fullsized":"2024-01-27T13:32:19.126882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067851+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:32:20.067851+0000","last_peered":"2024-01-27T13:32:20.067851+0000","last_clean":"2024-01-27T13:32:20.067851+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:32:20.067851+0000","last_undegraded":"2024-01-27T13:32:20.067851+0000","last_fullsized":"2024-01-27T13:32:20.067851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136359+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T13:32:19.136359+0000","last_peered":"2024-01-27T13:32:19.136359+0000","last_clean":"2024-01-27T13:32:19.136359+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T13:32:19.136359+0000","last_undegraded":"2024-01-27T13:32:19.136359+0000","last_fullsized":"2024-01-27T13:32:19.136359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126753+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:32:19.126753+0000","last_peered":"2024-01-27T13:32:19.126753+0000","last_clean":"2024-01-27T13:32:19.126753+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:32:19.126753+0000","last_undegraded":"2024-01-27T13:32:19.126753+0000","last_fullsized":"2024-01-27T13:32:19.126753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068389+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T13:32:20.068389+0000","last_peered":"2024-01-27T13:32:20.068389+0000","last_clean":"2024-01-27T13:32:20.068389+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T13:32:20.068389+0000","last_undegraded":"2024-01-27T13:32:20.068389+0000","last_fullsized":"2024-01-27T13:32:20.068389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068256+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:32:20.068256+0000","last_peered":"2024-01-27T13:32:20.068256+0000","last_clean":"2024-01-27T13:32:20.068256+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:32:20.068256+0000","last_undegraded":"2024-01-27T13:32:20.068256+0000","last_fullsized":"2024-01-27T13:32:20.068256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126917+0000","last_change":"2024-01-27T13:32:18.089623+0000","last_active":"2024-01-27T13:32:19.126917+0000","last_peered":"2024-01-27T13:32:19.126917+0000","last_clean":"2024-01-27T13:32:19.126917+0000","last_became_active":"2024-01-27T13:32:18.089293+0000","last_became_peered":"2024-01-27T13:32:18.089293+0000","last_unstale":"2024-01-27T13:32:19.126917+0000","last_undegraded":"2024-01-27T13:32:19.126917+0000","last_fullsized":"2024-01-27T13:32:19.126917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:09:14.847454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068742+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T13:32:20.068742+0000","last_peered":"2024-01-27T13:32:20.068742+0000","last_clean":"2024-01-27T13:32:20.068742+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T13:32:20.068742+0000","last_undegraded":"2024-01-27T13:32:20.068742+0000","last_fullsized":"2024-01-27T13:32:20.068742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068343+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:32:20.068343+0000","last_peered":"2024-01-27T13:32:20.068343+0000","last_clean":"2024-01-27T13:32:20.068343+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:32:20.068343+0000","last_undegraded":"2024-01-27T13:32:20.068343+0000","last_fullsized":"2024-01-27T13:32:20.068343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126918+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:32:19.126918+0000","last_peered":"2024-01-27T13:32:19.126918+0000","last_clean":"2024-01-27T13:32:19.126918+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:32:19.126918+0000","last_undegraded":"2024-01-27T13:32:19.126918+0000","last_fullsized":"2024-01-27T13:32:19.126918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067535+0000","last_change":"2024-01-27T13:32:13.633359+0000","last_active":"2024-01-27T13:32:20.067535+0000","last_peered":"2024-01-27T13:32:20.067535+0000","last_clean":"2024-01-27T13:32:20.067535+0000","last_became_active":"2024-01-27T13:32:13.632583+0000","last_became_peered":"2024-01-27T13:32:13.632583+0000","last_unstale":"2024-01-27T13:32:20.067535+0000","last_undegraded":"2024-01-27T13:32:20.067535+0000","last_fullsized":"2024-01-27T13:32:20.067535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067987+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:32:20.067987+0000","last_peered":"2024-01-27T13:32:20.067987+0000","last_clean":"2024-01-27T13:32:20.067987+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:32:20.067987+0000","last_undegraded":"2024-01-27T13:32:20.067987+0000","last_fullsized":"2024-01-27T13:32:20.067987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068554+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:32:20.068554+0000","last_peered":"2024-01-27T13:32:20.068554+0000","last_clean":"2024-01-27T13:32:20.068554+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:32:20.068554+0000","last_undegraded":"2024-01-27T13:32:20.068554+0000","last_fullsized":"2024-01-27T13:32:20.068554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127286+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:32:19.127286+0000","last_peered":"2024-01-27T13:32:19.127286+0000","last_clean":"2024-01-27T13:32:19.127286+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:32:19.127286+0000","last_undegraded":"2024-01-27T13:32:19.127286+0000","last_fullsized":"2024-01-27T13:32:19.127286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067511+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:32:20.067511+0000","last_peered":"2024-01-27T13:32:20.067511+0000","last_clean":"2024-01-27T13:32:20.067511+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:32:20.067511+0000","last_undegraded":"2024-01-27T13:32:20.067511+0000","last_fullsized":"2024-01-27T13:32:20.067511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127020+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:32:19.127020+0000","last_peered":"2024-01-27T13:32:19.127020+0000","last_clean":"2024-01-27T13:32:19.127020+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:32:19.127020+0000","last_undegraded":"2024-01-27T13:32:19.127020+0000","last_fullsized":"2024-01-27T13:32:19.127020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121405+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T13:32:19.121405+0000","last_peered":"2024-01-27T13:32:19.121405+0000","last_clean":"2024-01-27T13:32:19.121405+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T13:32:19.121405+0000","last_undegraded":"2024-01-27T13:32:19.121405+0000","last_fullsized":"2024-01-27T13:32:19.121405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068552+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:32:20.068552+0000","last_peered":"2024-01-27T13:32:20.068552+0000","last_clean":"2024-01-27T13:32:20.068552+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:32:20.068552+0000","last_undegraded":"2024-01-27T13:32:20.068552+0000","last_fullsized":"2024-01-27T13:32:20.068552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126776+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:32:19.126776+0000","last_peered":"2024-01-27T13:32:19.126776+0000","last_clean":"2024-01-27T13:32:19.126776+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:32:19.126776+0000","last_undegraded":"2024-01-27T13:32:19.126776+0000","last_fullsized":"2024-01-27T13:32:19.126776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068982+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T13:32:20.068982+0000","last_peered":"2024-01-27T13:32:20.068982+0000","last_clean":"2024-01-27T13:32:20.068982+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T13:32:20.068982+0000","last_undegraded":"2024-01-27T13:32:20.068982+0000","last_fullsized":"2024-01-27T13:32:20.068982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068533+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:32:20.068533+0000","last_peered":"2024-01-27T13:32:20.068533+0000","last_clean":"2024-01-27T13:32:20.068533+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:32:20.068533+0000","last_undegraded":"2024-01-27T13:32:20.068533+0000","last_fullsized":"2024-01-27T13:32:20.068533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067308+0000","last_change":"2024-01-27T13:32:18.347860+0000","last_active":"2024-01-27T13:32:20.067308+0000","last_peered":"2024-01-27T13:32:20.067308+0000","last_clean":"2024-01-27T13:32:20.067308+0000","last_became_active":"2024-01-27T13:32:18.347450+0000","last_became_peered":"2024-01-27T13:32:18.347450+0000","last_unstale":"2024-01-27T13:32:20.067308+0000","last_undegraded":"2024-01-27T13:32:20.067308+0000","last_fullsized":"2024-01-27T13:32:20.067308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068489+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T13:32:20.068489+0000","last_peered":"2024-01-27T13:32:20.068489+0000","last_clean":"2024-01-27T13:32:20.068489+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T13:32:20.068489+0000","last_undegraded":"2024-01-27T13:32:20.068489+0000","last_fullsized":"2024-01-27T13:32:20.068489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068378+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:32:20.068378+0000","last_peered":"2024-01-27T13:32:20.068378+0000","last_clean":"2024-01-27T13:32:20.068378+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:32:20.068378+0000","last_undegraded":"2024-01-27T13:32:20.068378+0000","last_fullsized":"2024-01-27T13:32:20.068378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121336+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:32:19.121336+0000","last_peered":"2024-01-27T13:32:19.121336+0000","last_clean":"2024-01-27T13:32:19.121336+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:32:19.121336+0000","last_undegraded":"2024-01-27T13:32:19.121336+0000","last_fullsized":"2024-01-27T13:32:19.121336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136462+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T13:32:19.136462+0000","last_peered":"2024-01-27T13:32:19.136462+0000","last_clean":"2024-01-27T13:32:19.136462+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T13:32:19.136462+0000","last_undegraded":"2024-01-27T13:32:19.136462+0000","last_fullsized":"2024-01-27T13:32:19.136462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068630+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:32:20.068630+0000","last_peered":"2024-01-27T13:32:20.068630+0000","last_clean":"2024-01-27T13:32:20.068630+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:32:20.068630+0000","last_undegraded":"2024-01-27T13:32:20.068630+0000","last_fullsized":"2024-01-27T13:32:20.068630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068322+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:32:20.068322+0000","last_peered":"2024-01-27T13:32:20.068322+0000","last_clean":"2024-01-27T13:32:20.068322+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:32:20.068322+0000","last_undegraded":"2024-01-27T13:32:20.068322+0000","last_fullsized":"2024-01-27T13:32:20.068322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127309+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T13:32:19.127309+0000","last_peered":"2024-01-27T13:32:19.127309+0000","last_clean":"2024-01-27T13:32:19.127309+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T13:32:19.127309+0000","last_undegraded":"2024-01-27T13:32:19.127309+0000","last_fullsized":"2024-01-27T13:32:19.127309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136304+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:32:19.136304+0000","last_peered":"2024-01-27T13:32:19.136304+0000","last_clean":"2024-01-27T13:32:19.136304+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:32:19.136304+0000","last_undegraded":"2024-01-27T13:32:19.136304+0000","last_fullsized":"2024-01-27T13:32:19.136304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068226+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:32:20.068226+0000","last_peered":"2024-01-27T13:32:20.068226+0000","last_clean":"2024-01-27T13:32:20.068226+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:32:20.068226+0000","last_undegraded":"2024-01-27T13:32:20.068226+0000","last_fullsized":"2024-01-27T13:32:20.068226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067668+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T13:32:20.067668+0000","last_peered":"2024-01-27T13:32:20.067668+0000","last_clean":"2024-01-27T13:32:20.067668+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T13:32:20.067668+0000","last_undegraded":"2024-01-27T13:32:20.067668+0000","last_fullsized":"2024-01-27T13:32:20.067668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821068+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T13:32:19.821068+0000","last_peered":"2024-01-27T13:32:19.821068+0000","last_clean":"2024-01-27T13:32:19.821068+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T13:32:19.821068+0000","last_undegraded":"2024-01-27T13:32:19.821068+0000","last_fullsized":"2024-01-27T13:32:19.821068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068619+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:32:20.068619+0000","last_peered":"2024-01-27T13:32:20.068619+0000","last_clean":"2024-01-27T13:32:20.068619+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:32:20.068619+0000","last_undegraded":"2024-01-27T13:32:20.068619+0000","last_fullsized":"2024-01-27T13:32:20.068619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.120856+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T13:32:19.120856+0000","last_peered":"2024-01-27T13:32:19.120856+0000","last_clean":"2024-01-27T13:32:19.120856+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T13:32:19.120856+0000","last_undegraded":"2024-01-27T13:32:19.120856+0000","last_fullsized":"2024-01-27T13:32:19.120856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067610+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T13:32:20.067610+0000","last_peered":"2024-01-27T13:32:20.067610+0000","last_clean":"2024-01-27T13:32:20.067610+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T13:32:20.067610+0000","last_undegraded":"2024-01-27T13:32:20.067610+0000","last_fullsized":"2024-01-27T13:32:20.067610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121399+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:32:19.121399+0000","last_peered":"2024-01-27T13:32:19.121399+0000","last_clean":"2024-01-27T13:32:19.121399+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:32:19.121399+0000","last_undegraded":"2024-01-27T13:32:19.121399+0000","last_fullsized":"2024-01-27T13:32:19.121399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067670+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T13:32:20.067670+0000","last_peered":"2024-01-27T13:32:20.067670+0000","last_clean":"2024-01-27T13:32:20.067670+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T13:32:20.067670+0000","last_undegraded":"2024-01-27T13:32:20.067670+0000","last_fullsized":"2024-01-27T13:32:20.067670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136077+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:32:19.136077+0000","last_peered":"2024-01-27T13:32:19.136077+0000","last_clean":"2024-01-27T13:32:19.136077+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:32:19.136077+0000","last_undegraded":"2024-01-27T13:32:19.136077+0000","last_fullsized":"2024-01-27T13:32:19.136077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067799+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:32:20.067799+0000","last_peered":"2024-01-27T13:32:20.067799+0000","last_clean":"2024-01-27T13:32:20.067799+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:32:20.067799+0000","last_undegraded":"2024-01-27T13:32:20.067799+0000","last_fullsized":"2024-01-27T13:32:20.067799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068032+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:32:20.068032+0000","last_peered":"2024-01-27T13:32:20.068032+0000","last_clean":"2024-01-27T13:32:20.068032+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:32:20.068032+0000","last_undegraded":"2024-01-27T13:32:20.068032+0000","last_fullsized":"2024-01-27T13:32:20.068032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068100+0000","last_change":"2024-01-27T13:32:13.603513+0000","last_active":"2024-01-27T13:32:20.068100+0000","last_peered":"2024-01-27T13:32:20.068100+0000","last_clean":"2024-01-27T13:32:20.068100+0000","last_became_active":"2024-01-27T13:32:13.603259+0000","last_became_peered":"2024-01-27T13:32:13.603259+0000","last_unstale":"2024-01-27T13:32:20.068100+0000","last_undegraded":"2024-01-27T13:32:20.068100+0000","last_fullsized":"2024-01-27T13:32:20.068100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:09:10.194290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821270+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:32:19.821270+0000","last_peered":"2024-01-27T13:32:19.821270+0000","last_clean":"2024-01-27T13:32:19.821270+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:32:19.821270+0000","last_undegraded":"2024-01-27T13:32:19.821270+0000","last_fullsized":"2024-01-27T13:32:19.821270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067552+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:32:20.067552+0000","last_peered":"2024-01-27T13:32:20.067552+0000","last_clean":"2024-01-27T13:32:20.067552+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:32:20.067552+0000","last_undegraded":"2024-01-27T13:32:20.067552+0000","last_fullsized":"2024-01-27T13:32:20.067552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136152+0000","last_change":"2024-01-27T13:32:13.637629+0000","last_active":"2024-01-27T13:32:19.136152+0000","last_peered":"2024-01-27T13:32:19.136152+0000","last_clean":"2024-01-27T13:32:19.136152+0000","last_became_active":"2024-01-27T13:32:13.637056+0000","last_became_peered":"2024-01-27T13:32:13.637056+0000","last_unstale":"2024-01-27T13:32:19.136152+0000","last_undegraded":"2024-01-27T13:32:19.136152+0000","last_fullsized":"2024-01-27T13:32:19.136152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068363+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:32:20.068363+0000","last_peered":"2024-01-27T13:32:20.068363+0000","last_clean":"2024-01-27T13:32:20.068363+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:32:20.068363+0000","last_undegraded":"2024-01-27T13:32:20.068363+0000","last_fullsized":"2024-01-27T13:32:20.068363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121499+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:32:19.121499+0000","last_peered":"2024-01-27T13:32:19.121499+0000","last_clean":"2024-01-27T13:32:19.121499+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:32:19.121499+0000","last_undegraded":"2024-01-27T13:32:19.121499+0000","last_fullsized":"2024-01-27T13:32:19.121499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068279+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T13:32:20.068279+0000","last_peered":"2024-01-27T13:32:20.068279+0000","last_clean":"2024-01-27T13:32:20.068279+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T13:32:20.068279+0000","last_undegraded":"2024-01-27T13:32:20.068279+0000","last_fullsized":"2024-01-27T13:32:20.068279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821363+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:32:19.821363+0000","last_peered":"2024-01-27T13:32:19.821363+0000","last_clean":"2024-01-27T13:32:19.821363+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:32:19.821363+0000","last_undegraded":"2024-01-27T13:32:19.821363+0000","last_fullsized":"2024-01-27T13:32:19.821363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.135827+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:32:19.135827+0000","last_peered":"2024-01-27T13:32:19.135827+0000","last_clean":"2024-01-27T13:32:19.135827+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:32:19.135827+0000","last_undegraded":"2024-01-27T13:32:19.135827+0000","last_fullsized":"2024-01-27T13:32:19.135827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068014+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T13:32:20.068014+0000","last_peered":"2024-01-27T13:32:20.068014+0000","last_clean":"2024-01-27T13:32:20.068014+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T13:32:20.068014+0000","last_undegraded":"2024-01-27T13:32:20.068014+0000","last_fullsized":"2024-01-27T13:32:20.068014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127235+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:32:19.127235+0000","last_peered":"2024-01-27T13:32:19.127235+0000","last_clean":"2024-01-27T13:32:19.127235+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:32:19.127235+0000","last_undegraded":"2024-01-27T13:32:19.127235+0000","last_fullsized":"2024-01-27T13:32:19.127235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126869+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:32:19.126869+0000","last_peered":"2024-01-27T13:32:19.126869+0000","last_clean":"2024-01-27T13:32:19.126869+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:32:19.126869+0000","last_undegraded":"2024-01-27T13:32:19.126869+0000","last_fullsized":"2024-01-27T13:32:19.126869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067625+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T13:32:20.067625+0000","last_peered":"2024-01-27T13:32:20.067625+0000","last_clean":"2024-01-27T13:32:20.067625+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T13:32:20.067625+0000","last_undegraded":"2024-01-27T13:32:20.067625+0000","last_fullsized":"2024-01-27T13:32:20.067625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.820964+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:32:19.820964+0000","last_peered":"2024-01-27T13:32:19.820964+0000","last_clean":"2024-01-27T13:32:19.820964+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:32:19.820964+0000","last_undegraded":"2024-01-27T13:32:19.820964+0000","last_fullsized":"2024-01-27T13:32:19.820964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121189+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:32:19.121189+0000","last_peered":"2024-01-27T13:32:19.121189+0000","last_clean":"2024-01-27T13:32:19.121189+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:32:19.121189+0000","last_undegraded":"2024-01-27T13:32:19.121189+0000","last_fullsized":"2024-01-27T13:32:19.121189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067558+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T13:32:20.067558+0000","last_peered":"2024-01-27T13:32:20.067558+0000","last_clean":"2024-01-27T13:32:20.067558+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T13:32:20.067558+0000","last_undegraded":"2024-01-27T13:32:20.067558+0000","last_fullsized":"2024-01-27T13:32:20.067558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067722+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:32:20.067722+0000","last_peered":"2024-01-27T13:32:20.067722+0000","last_clean":"2024-01-27T13:32:20.067722+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:32:20.067722+0000","last_undegraded":"2024-01-27T13:32:20.067722+0000","last_fullsized":"2024-01-27T13:32:20.067722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068948+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:32:20.068948+0000","last_peered":"2024-01-27T13:32:20.068948+0000","last_clean":"2024-01-27T13:32:20.068948+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:32:20.068948+0000","last_undegraded":"2024-01-27T13:32:20.068948+0000","last_fullsized":"2024-01-27T13:32:20.068948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068089+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T13:32:20.068089+0000","last_peered":"2024-01-27T13:32:20.068089+0000","last_clean":"2024-01-27T13:32:20.068089+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T13:32:20.068089+0000","last_undegraded":"2024-01-27T13:32:20.068089+0000","last_fullsized":"2024-01-27T13:32:20.068089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136201+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:32:19.136201+0000","last_peered":"2024-01-27T13:32:19.136201+0000","last_clean":"2024-01-27T13:32:19.136201+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:32:19.136201+0000","last_undegraded":"2024-01-27T13:32:19.136201+0000","last_fullsized":"2024-01-27T13:32:19.136201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068043+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:32:20.068043+0000","last_peered":"2024-01-27T13:32:20.068043+0000","last_clean":"2024-01-27T13:32:20.068043+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:32:20.068043+0000","last_undegraded":"2024-01-27T13:32:20.068043+0000","last_fullsized":"2024-01-27T13:32:20.068043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121092+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T13:32:19.121092+0000","last_peered":"2024-01-27T13:32:19.121092+0000","last_clean":"2024-01-27T13:32:19.121092+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T13:32:19.121092+0000","last_undegraded":"2024-01-27T13:32:19.121092+0000","last_fullsized":"2024-01-27T13:32:19.121092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121569+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:32:19.121569+0000","last_peered":"2024-01-27T13:32:19.121569+0000","last_clean":"2024-01-27T13:32:19.121569+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:32:19.121569+0000","last_undegraded":"2024-01-27T13:32:19.121569+0000","last_fullsized":"2024-01-27T13:32:19.121569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136376+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:32:19.136376+0000","last_peered":"2024-01-27T13:32:19.136376+0000","last_clean":"2024-01-27T13:32:19.136376+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:32:19.136376+0000","last_undegraded":"2024-01-27T13:32:19.136376+0000","last_fullsized":"2024-01-27T13:32:19.136376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068015+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T13:32:20.068015+0000","last_peered":"2024-01-27T13:32:20.068015+0000","last_clean":"2024-01-27T13:32:20.068015+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T13:32:20.068015+0000","last_undegraded":"2024-01-27T13:32:20.068015+0000","last_fullsized":"2024-01-27T13:32:20.068015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:35.150945+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:32:35.150945+0000","last_peered":"2024-01-27T13:32:35.150945+0000","last_clean":"2024-01-27T13:32:35.150945+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:32:35.150945+0000","last_undegraded":"2024-01-27T13:32:35.150945+0000","last_fullsized":"2024-01-27T13:32:35.150945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068123+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:32:20.068123+0000","last_peered":"2024-01-27T13:32:20.068123+0000","last_clean":"2024-01-27T13:32:20.068123+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:32:20.068123+0000","last_undegraded":"2024-01-27T13:32:20.068123+0000","last_fullsized":"2024-01-27T13:32:20.068123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127159+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T13:32:19.127159+0000","last_peered":"2024-01-27T13:32:19.127159+0000","last_clean":"2024-01-27T13:32:19.127159+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T13:32:19.127159+0000","last_undegraded":"2024-01-27T13:32:19.127159+0000","last_fullsized":"2024-01-27T13:32:19.127159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068260+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:32:20.068260+0000","last_peered":"2024-01-27T13:32:20.068260+0000","last_clean":"2024-01-27T13:32:20.068260+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:32:20.068260+0000","last_undegraded":"2024-01-27T13:32:20.068260+0000","last_fullsized":"2024-01-27T13:32:20.068260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127333+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:32:19.127333+0000","last_peered":"2024-01-27T13:32:19.127333+0000","last_clean":"2024-01-27T13:32:19.127333+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:32:19.127333+0000","last_undegraded":"2024-01-27T13:32:19.127333+0000","last_fullsized":"2024-01-27T13:32:19.127333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121228+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T13:32:19.121228+0000","last_peered":"2024-01-27T13:32:19.121228+0000","last_clean":"2024-01-27T13:32:19.121228+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T13:32:19.121228+0000","last_undegraded":"2024-01-27T13:32:19.121228+0000","last_fullsized":"2024-01-27T13:32:19.121228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136268+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:32:19.136268+0000","last_peered":"2024-01-27T13:32:19.136268+0000","last_clean":"2024-01-27T13:32:19.136268+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:32:19.136268+0000","last_undegraded":"2024-01-27T13:32:19.136268+0000","last_fullsized":"2024-01-27T13:32:19.136268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067455+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:32:20.067455+0000","last_peered":"2024-01-27T13:32:20.067455+0000","last_clean":"2024-01-27T13:32:20.067455+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:32:20.067455+0000","last_undegraded":"2024-01-27T13:32:20.067455+0000","last_fullsized":"2024-01-27T13:32:20.067455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136194+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T13:32:19.136194+0000","last_peered":"2024-01-27T13:32:19.136194+0000","last_clean":"2024-01-27T13:32:19.136194+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T13:32:19.136194+0000","last_undegraded":"2024-01-27T13:32:19.136194+0000","last_fullsized":"2024-01-27T13:32:19.136194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068465+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:32:20.068465+0000","last_peered":"2024-01-27T13:32:20.068465+0000","last_clean":"2024-01-27T13:32:20.068465+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:32:20.068465+0000","last_undegraded":"2024-01-27T13:32:20.068465+0000","last_fullsized":"2024-01-27T13:32:20.068465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067433+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:32:20.067433+0000","last_peered":"2024-01-27T13:32:20.067433+0000","last_clean":"2024-01-27T13:32:20.067433+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:32:20.067433+0000","last_undegraded":"2024-01-27T13:32:20.067433+0000","last_fullsized":"2024-01-27T13:32:20.067433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121117+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:32:19.121117+0000","last_peered":"2024-01-27T13:32:19.121117+0000","last_clean":"2024-01-27T13:32:19.121117+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:32:19.121117+0000","last_undegraded":"2024-01-27T13:32:19.121117+0000","last_fullsized":"2024-01-27T13:32:19.121117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067772+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T13:32:20.067772+0000","last_peered":"2024-01-27T13:32:20.067772+0000","last_clean":"2024-01-27T13:32:20.067772+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T13:32:20.067772+0000","last_undegraded":"2024-01-27T13:32:20.067772+0000","last_fullsized":"2024-01-27T13:32:20.067772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136233+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:32:19.136233+0000","last_peered":"2024-01-27T13:32:19.136233+0000","last_clean":"2024-01-27T13:32:19.136233+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:32:19.136233+0000","last_undegraded":"2024-01-27T13:32:19.136233+0000","last_fullsized":"2024-01-27T13:32:19.136233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068328+0000","last_change":"2024-01-27T13:32:18.071494+0000","last_active":"2024-01-27T13:32:20.068328+0000","last_peered":"2024-01-27T13:32:20.068328+0000","last_clean":"2024-01-27T13:32:20.068328+0000","last_became_active":"2024-01-27T13:32:18.071206+0000","last_became_peered":"2024-01-27T13:32:18.071206+0000","last_unstale":"2024-01-27T13:32:20.068328+0000","last_undegraded":"2024-01-27T13:32:20.068328+0000","last_fullsized":"2024-01-27T13:32:20.068328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067463+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T13:32:20.067463+0000","last_peered":"2024-01-27T13:32:20.067463+0000","last_clean":"2024-01-27T13:32:20.067463+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T13:32:20.067463+0000","last_undegraded":"2024-01-27T13:32:20.067463+0000","last_fullsized":"2024-01-27T13:32:20.067463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067725+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:32:20.067725+0000","last_peered":"2024-01-27T13:32:20.067725+0000","last_clean":"2024-01-27T13:32:20.067725+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:32:20.067725+0000","last_undegraded":"2024-01-27T13:32:20.067725+0000","last_fullsized":"2024-01-27T13:32:20.067725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068470+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:32:20.068470+0000","last_peered":"2024-01-27T13:32:20.068470+0000","last_clean":"2024-01-27T13:32:20.068470+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:32:20.068470+0000","last_undegraded":"2024-01-27T13:32:20.068470+0000","last_fullsized":"2024-01-27T13:32:20.068470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121540+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T13:32:19.121540+0000","last_peered":"2024-01-27T13:32:19.121540+0000","last_clean":"2024-01-27T13:32:19.121540+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T13:32:19.121540+0000","last_undegraded":"2024-01-27T13:32:19.121540+0000","last_fullsized":"2024-01-27T13:32:19.121540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821168+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:32:19.821168+0000","last_peered":"2024-01-27T13:32:19.821168+0000","last_clean":"2024-01-27T13:32:19.821168+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:32:19.821168+0000","last_undegraded":"2024-01-27T13:32:19.821168+0000","last_fullsized":"2024-01-27T13:32:19.821168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068819+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:32:20.068819+0000","last_peered":"2024-01-27T13:32:20.068819+0000","last_clean":"2024-01-27T13:32:20.068819+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:32:20.068819+0000","last_undegraded":"2024-01-27T13:32:20.068819+0000","last_fullsized":"2024-01-27T13:32:20.068819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.126962+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T13:32:19.126962+0000","last_peered":"2024-01-27T13:32:19.126962+0000","last_clean":"2024-01-27T13:32:19.126962+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T13:32:19.126962+0000","last_undegraded":"2024-01-27T13:32:19.126962+0000","last_fullsized":"2024-01-27T13:32:19.126962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068089+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:32:20.068089+0000","last_peered":"2024-01-27T13:32:20.068089+0000","last_clean":"2024-01-27T13:32:20.068089+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:32:20.068089+0000","last_undegraded":"2024-01-27T13:32:20.068089+0000","last_fullsized":"2024-01-27T13:32:20.068089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067695+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T13:32:20.067695+0000","last_peered":"2024-01-27T13:32:20.067695+0000","last_clean":"2024-01-27T13:32:20.067695+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T13:32:20.067695+0000","last_undegraded":"2024-01-27T13:32:20.067695+0000","last_fullsized":"2024-01-27T13:32:20.067695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821170+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T13:32:19.821170+0000","last_peered":"2024-01-27T13:32:19.821170+0000","last_clean":"2024-01-27T13:32:19.821170+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T13:32:19.821170+0000","last_undegraded":"2024-01-27T13:32:19.821170+0000","last_fullsized":"2024-01-27T13:32:19.821170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136100+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T13:32:19.136100+0000","last_peered":"2024-01-27T13:32:19.136100+0000","last_clean":"2024-01-27T13:32:19.136100+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T13:32:19.136100+0000","last_undegraded":"2024-01-27T13:32:19.136100+0000","last_fullsized":"2024-01-27T13:32:19.136100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121447+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T13:32:19.121447+0000","last_peered":"2024-01-27T13:32:19.121447+0000","last_clean":"2024-01-27T13:32:19.121447+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T13:32:19.121447+0000","last_undegraded":"2024-01-27T13:32:19.121447+0000","last_fullsized":"2024-01-27T13:32:19.121447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068353+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T13:32:20.068353+0000","last_peered":"2024-01-27T13:32:20.068353+0000","last_clean":"2024-01-27T13:32:20.068353+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T13:32:20.068353+0000","last_undegraded":"2024-01-27T13:32:20.068353+0000","last_fullsized":"2024-01-27T13:32:20.068353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068094+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T13:32:20.068094+0000","last_peered":"2024-01-27T13:32:20.068094+0000","last_clean":"2024-01-27T13:32:20.068094+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T13:32:20.068094+0000","last_undegraded":"2024-01-27T13:32:20.068094+0000","last_fullsized":"2024-01-27T13:32:20.068094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068034+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T13:32:20.068034+0000","last_peered":"2024-01-27T13:32:20.068034+0000","last_clean":"2024-01-27T13:32:20.068034+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T13:32:20.068034+0000","last_undegraded":"2024-01-27T13:32:20.068034+0000","last_fullsized":"2024-01-27T13:32:20.068034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068936+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T13:32:20.068936+0000","last_peered":"2024-01-27T13:32:20.068936+0000","last_clean":"2024-01-27T13:32:20.068936+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T13:32:20.068936+0000","last_undegraded":"2024-01-27T13:32:20.068936+0000","last_fullsized":"2024-01-27T13:32:20.068936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136098+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T13:32:19.136098+0000","last_peered":"2024-01-27T13:32:19.136098+0000","last_clean":"2024-01-27T13:32:19.136098+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T13:32:19.136098+0000","last_undegraded":"2024-01-27T13:32:19.136098+0000","last_fullsized":"2024-01-27T13:32:19.136098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067631+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T13:32:20.067631+0000","last_peered":"2024-01-27T13:32:20.067631+0000","last_clean":"2024-01-27T13:32:20.067631+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T13:32:20.067631+0000","last_undegraded":"2024-01-27T13:32:20.067631+0000","last_fullsized":"2024-01-27T13:32:20.067631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136091+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T13:32:19.136091+0000","last_peered":"2024-01-27T13:32:19.136091+0000","last_clean":"2024-01-27T13:32:19.136091+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T13:32:19.136091+0000","last_undegraded":"2024-01-27T13:32:19.136091+0000","last_fullsized":"2024-01-27T13:32:19.136091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121319+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T13:32:19.121319+0000","last_peered":"2024-01-27T13:32:19.121319+0000","last_clean":"2024-01-27T13:32:19.121319+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T13:32:19.121319+0000","last_undegraded":"2024-01-27T13:32:19.121319+0000","last_fullsized":"2024-01-27T13:32:19.121319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067920+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T13:32:20.067920+0000","last_peered":"2024-01-27T13:32:20.067920+0000","last_clean":"2024-01-27T13:32:20.067920+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T13:32:20.067920+0000","last_undegraded":"2024-01-27T13:32:20.067920+0000","last_fullsized":"2024-01-27T13:32:20.067920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068300+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T13:32:20.068300+0000","last_peered":"2024-01-27T13:32:20.068300+0000","last_clean":"2024-01-27T13:32:20.068300+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T13:32:20.068300+0000","last_undegraded":"2024-01-27T13:32:20.068300+0000","last_fullsized":"2024-01-27T13:32:20.068300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.821300+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T13:32:19.821300+0000","last_peered":"2024-01-27T13:32:19.821300+0000","last_clean":"2024-01-27T13:32:19.821300+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T13:32:19.821300+0000","last_undegraded":"2024-01-27T13:32:19.821300+0000","last_fullsized":"2024-01-27T13:32:19.821300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136451+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T13:32:19.136451+0000","last_peered":"2024-01-27T13:32:19.136451+0000","last_clean":"2024-01-27T13:32:19.136451+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T13:32:19.136451+0000","last_undegraded":"2024-01-27T13:32:19.136451+0000","last_fullsized":"2024-01-27T13:32:19.136451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.135829+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T13:32:19.135829+0000","last_peered":"2024-01-27T13:32:19.135829+0000","last_clean":"2024-01-27T13:32:19.135829+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T13:32:19.135829+0000","last_undegraded":"2024-01-27T13:32:19.135829+0000","last_fullsized":"2024-01-27T13:32:19.135829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067886+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T13:32:20.067886+0000","last_peered":"2024-01-27T13:32:20.067886+0000","last_clean":"2024-01-27T13:32:20.067886+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T13:32:20.067886+0000","last_undegraded":"2024-01-27T13:32:20.067886+0000","last_fullsized":"2024-01-27T13:32:20.067886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121022+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T13:32:19.121022+0000","last_peered":"2024-01-27T13:32:19.121022+0000","last_clean":"2024-01-27T13:32:19.121022+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T13:32:19.121022+0000","last_undegraded":"2024-01-27T13:32:19.121022+0000","last_fullsized":"2024-01-27T13:32:19.121022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068645+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T13:32:20.068645+0000","last_peered":"2024-01-27T13:32:20.068645+0000","last_clean":"2024-01-27T13:32:20.068645+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T13:32:20.068645+0000","last_undegraded":"2024-01-27T13:32:20.068645+0000","last_fullsized":"2024-01-27T13:32:20.068645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.127140+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T13:32:19.127140+0000","last_peered":"2024-01-27T13:32:19.127140+0000","last_clean":"2024-01-27T13:32:19.127140+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T13:32:19.127140+0000","last_undegraded":"2024-01-27T13:32:19.127140+0000","last_fullsized":"2024-01-27T13:32:19.127140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068128+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T13:32:20.068128+0000","last_peered":"2024-01-27T13:32:20.068128+0000","last_clean":"2024-01-27T13:32:20.068128+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T13:32:20.068128+0000","last_undegraded":"2024-01-27T13:32:20.068128+0000","last_fullsized":"2024-01-27T13:32:20.068128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068230+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T13:32:20.068230+0000","last_peered":"2024-01-27T13:32:20.068230+0000","last_clean":"2024-01-27T13:32:20.068230+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T13:32:20.068230+0000","last_undegraded":"2024-01-27T13:32:20.068230+0000","last_fullsized":"2024-01-27T13:32:20.068230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068260+0000","last_change":"2024-01-27T13:32:13.603424+0000","last_active":"2024-01-27T13:32:20.068260+0000","last_peered":"2024-01-27T13:32:20.068260+0000","last_clean":"2024-01-27T13:32:20.068260+0000","last_became_active":"2024-01-27T13:32:13.603168+0000","last_became_peered":"2024-01-27T13:32:13.603168+0000","last_unstale":"2024-01-27T13:32:20.068260+0000","last_undegraded":"2024-01-27T13:32:20.068260+0000","last_fullsized":"2024-01-27T13:32:20.068260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:00.668769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067374+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T13:32:20.067374+0000","last_peered":"2024-01-27T13:32:20.067374+0000","last_clean":"2024-01-27T13:32:20.067374+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T13:32:20.067374+0000","last_undegraded":"2024-01-27T13:32:20.067374+0000","last_fullsized":"2024-01-27T13:32:20.067374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067607+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T13:32:20.067607+0000","last_peered":"2024-01-27T13:32:20.067607+0000","last_clean":"2024-01-27T13:32:20.067607+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T13:32:20.067607+0000","last_undegraded":"2024-01-27T13:32:20.067607+0000","last_fullsized":"2024-01-27T13:32:20.067607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136005+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T13:32:19.136005+0000","last_peered":"2024-01-27T13:32:19.136005+0000","last_clean":"2024-01-27T13:32:19.136005+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T13:32:19.136005+0000","last_undegraded":"2024-01-27T13:32:19.136005+0000","last_fullsized":"2024-01-27T13:32:19.136005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.067900+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T13:32:20.067900+0000","last_peered":"2024-01-27T13:32:20.067900+0000","last_clean":"2024-01-27T13:32:20.067900+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T13:32:20.067900+0000","last_undegraded":"2024-01-27T13:32:20.067900+0000","last_fullsized":"2024-01-27T13:32:20.067900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.136052+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T13:32:19.136052+0000","last_peered":"2024-01-27T13:32:19.136052+0000","last_clean":"2024-01-27T13:32:19.136052+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T13:32:19.136052+0000","last_undegraded":"2024-01-27T13:32:19.136052+0000","last_fullsized":"2024-01-27T13:32:19.136052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:19.121020+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T13:32:19.121020+0000","last_peered":"2024-01-27T13:32:19.121020+0000","last_clean":"2024-01-27T13:32:19.121020+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T13:32:19.121020+0000","last_undegraded":"2024-01-27T13:32:19.121020+0000","last_fullsized":"2024-01-27T13:32:19.121020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068287+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T13:32:20.068287+0000","last_peered":"2024-01-27T13:32:20.068287+0000","last_clean":"2024-01-27T13:32:20.068287+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T13:32:20.068287+0000","last_undegraded":"2024-01-27T13:32:20.068287+0000","last_fullsized":"2024-01-27T13:32:20.068287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-01-27T13:32:20.068123+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T13:32:20.068123+0000","last_peered":"2024-01-27T13:32:20.068123+0000","last_clean":"2024-01-27T13:32:20.068123+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T13:32:20.068123+0000","last_undegraded":"2024-01-27T13:32:20.068123+0000","last_fullsized":"2024-01-27T13:32:20.068123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":106146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":258048,"data_stored":102305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":266240,"data_stored":102465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":327680,"data_stored":693255,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":102395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":102431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":693311,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T13:32:48.966 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-27T13:32:48.966 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-27T13:32:48.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-27T13:32:48.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-27T13:32:48.967 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-27T13:32:49.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.110+0000 7f023ad02640 1 Processor -- start 2024-01-27T13:32:49.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.110+0000 7f023ad02640 1 -- start start 2024-01-27T13:32:49.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.110+0000 7f023ad02640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f02340c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f023ad02640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02340c4750 0x7f02340c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f023ad02640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023415a280 con 0x7f02340c99d0 2024-01-27T13:32:49.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f023ad02640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340c6750 con 0x7f02340c4750 2024-01-27T13:32:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f023ad02640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02340c9e60 con 0x7f0234153ca0 2024-01-27T13:32:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f0233fff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f02340c4750 0x7f02340c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f0238a9e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f02340c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f023929f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f02340c99d0 0x7f023406bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:36724/0 (socket says 172.21.15.46:36724) 2024-01-27T13:32:49.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.111+0000 7f023929f640 1 -- 172.21.15.46:0/3021703527 learned_addr learned my addr 172.21.15.46:0/3021703527 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.113+0000 7f02337fe640 1 -- 172.21.15.46:0/3021703527 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456091847 0 0) 0x7f023415a280 con 0x7f02340c99d0 2024-01-27T13:32:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.113+0000 7f02337fe640 1 -- 172.21.15.46:0/3021703527 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0220003520 con 0x7f02340c99d0 2024-01-27T13:32:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.114+0000 7f0233fff640 1 -- 172.21.15.46:0/3021703527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 msgr2=0x7f02340c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.114+0000 7f0233fff640 1 --2- 172.21.15.46:0/3021703527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f02340c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.114+0000 7f0233fff640 1 -- 172.21.15.46:0/3021703527 >> v1:172.21.15.78:6789/0 conn(0x7f02340c99d0 legacy=0x7f023406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.114+0000 7f0233fff640 1 -- 172.21.15.46:0/3021703527 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023415a790 con 0x7f02340c4750 2024-01-27T13:32:49.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.116+0000 7f0233fff640 1 --2- 172.21.15.46:0/3021703527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f02340c5b00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0224009d90 tx=0x7f022402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901c72bb36f13a6b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:49.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.119+0000 7f02337fe640 1 -- 172.21.15.46:0/3021703527 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022402cce0 con 0x7f02340c4750 2024-01-27T13:32:49.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.119+0000 7f02337fe640 1 -- 172.21.15.46:0/3021703527 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022402ce40 con 0x7f02340c4750 2024-01-27T13:32:49.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.119+0000 7f02337fe640 1 -- 172.21.15.46:0/3021703527 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224034660 con 0x7f02340c4750 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 -- 172.21.15.46:0/3021703527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 msgr2=0x7f02340c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 --2- 172.21.15.46:0/3021703527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f02340c5b00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0224009d90 tx=0x7f022402bf30 comp rx=0 tx=0).stop 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 -- 172.21.15.46:0/3021703527 shutdown_connections 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 --2- 172.21.15.46:0/3021703527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f02340c5b00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 --2- 172.21.15.46:0/3021703527 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f02340c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 -- 172.21.15.46:0/3021703527 >> 172.21.15.46:0/3021703527 conn(0x7f02340cf230 msgr2=0x7f02340cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 -- 172.21.15.46:0/3021703527 shutdown_connections 2024-01-27T13:32:49.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.120+0000 7f023ad02640 1 -- 172.21.15.46:0/3021703527 wait complete. 2024-01-27T13:32:49.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.121+0000 7f023ad02640 1 Processor -- start 2024-01-27T13:32:49.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.121+0000 7f023ad02640 1 -- start start 2024-01-27T13:32:49.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.122+0000 7f023ad02640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f0234157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.122+0000 7f023ad02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02340c99d0 0x7f02341f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.122+0000 7f023ad02640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f023414f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.122+0000 7f023ad02640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234152bd0 con 0x7f02340c4750 2024-01-27T13:32:49.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.122+0000 7f023ad02640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234150ec0 con 0x7f02340c99d0 2024-01-27T13:32:49.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.122+0000 7f023ad02640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02341f09e0 con 0x7f0234153ca0 2024-01-27T13:32:49.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.123+0000 7f023929f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f023414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.123+0000 7f0233fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02340c99d0 0x7f02341f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.123+0000 7f0238a9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f0234157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.123+0000 7f023929f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f023414f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43634/0 (socket says 172.21.15.46:43634) 2024-01-27T13:32:49.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.123+0000 7f023929f640 1 -- 172.21.15.46:0/1161037174 learned_addr learned my addr 172.21.15.46:0/1161037174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:49.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f0238a9e640 1 -- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 msgr2=0x7f023414f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f0238a9e640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f023414f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f0238a9e640 1 -- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02340c99d0 msgr2=0x7f02341f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f0238a9e640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02340c99d0 0x7f02341f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f0238a9e640 1 -- 172.21.15.46:0/1161037174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224009a70 con 0x7f02340c4750 2024-01-27T13:32:49.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f0233fff640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02340c99d0 0x7f02341f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:49.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.127+0000 7f023929f640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f023414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:49.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.129+0000 7f0238a9e640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f0234157460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f022c00e850 tx=0x7f022c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:49.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.133+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c0095b0 con 0x7f02340c4750 2024-01-27T13:32:49.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.133+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c00c940 con 0x7f02340c4750 2024-01-27T13:32:49.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.133+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c00ccd0 con 0x7f02340c4750 2024-01-27T13:32:49.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.133+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0234150900 con 0x7f02340c4750 2024-01-27T13:32:49.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.133+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02341f32a0 con 0x7f02340c4750 2024-01-27T13:32:49.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.134+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0234067ca0 con 0x7f02340c4750 2024-01-27T13:32:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.154+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f022c013470 con 0x7f02340c4750 2024-01-27T13:32:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.154+0000 7f02317fa640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f021406af20 0x7f021406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.154+0000 7f0233fff640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f021406af20 0x7f021406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.155+0000 7f0233fff640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f021406af20 0x7f021406d3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0224036000 tx=0x7f0224030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.408+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f022c00ce30 con 0x7f02340c4750 2024-01-27T13:32:49.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.408+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f022c054eb0 con 0x7f02340c4750 2024-01-27T13:32:49.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.651+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f02341f3100 con 0x7f02340c4750 2024-01-27T13:32:49.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.803+0000 7f02317fa640 1 -- 172.21.15.46:0/1161037174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170774 (secure 0 0 0) 0x7f02341f3100 con 0x7f02340c4750 2024-01-27T13:32:49.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f021406af20 msgr2=0x7f021406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f021406af20 0x7f021406d3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0224036000 tx=0x7f0224030000 comp rx=0 tx=0).stop 2024-01-27T13:32:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 msgr2=0x7f0234157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f0234157460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f022c00e850 tx=0x7f022c00ed10 comp rx=0 tx=0).stop 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 shutdown_connections 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f021406af20 0x7f021406d3e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0234153ca0 0x7f023414f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02340c99d0 0x7f02341f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 --2- 172.21.15.46:0/1161037174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02340c4750 0x7f0234157460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 >> 172.21.15.46:0/1161037174 conn(0x7f02340cf230 msgr2=0x7f02340ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 shutdown_connections 2024-01-27T13:32:49.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.806+0000 7f023ad02640 1 -- 172.21.15.46:0/1161037174 wait complete. 2024-01-27T13:32:49.809 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":805234491},{"type":"v1","addr":"172.21.15.46:6801","nonce":805234491}]},"active_addr":"172.21.15.46:6801/805234491","active_change":"2024-01-27T13:31:49.247890+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2945081783}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":2968089020}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":36218593}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1262290164}]}]} 2024-01-27T13:32:49.812 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-27T13:32:49.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-27T13:32:49.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:49.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.926+0000 7f4ae9dde640 1 Processor -- start 2024-01-27T13:32:49.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.926+0000 7f4ae9dde640 1 -- start start 2024-01-27T13:32:49.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.927+0000 7f4ae9dde640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ae40c2ca0 0x7f4ae41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.927+0000 7f4ae9dde640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40ccf60 con 0x7f4ae40c28c0 2024-01-27T13:32:49.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.927+0000 7f4ae9dde640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40ca800 con 0x7f4ae40c77d0 2024-01-27T13:32:49.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.927+0000 7f4ae9dde640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae41576d0 con 0x7f4ae40c2ca0 2024-01-27T13:32:49.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.927+0000 7f4ae2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ae40c2ca0 0x7f4ae41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.928+0000 7f4ae2ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ae40c2ca0 0x7f4ae41514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56280/0 (socket says 172.21.15.46:56280) 2024-01-27T13:32:49.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.928+0000 7f4ae2ffd640 1 -- 172.21.15.46:0/3364294193 learned_addr learned my addr 172.21.15.46:0/3364294193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:49.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.931+0000 7f4ae2ffd640 1 -- 172.21.15.46:0/3364294193 >> v1:172.21.15.78:6789/0 conn(0x7f4ae40c77d0 legacy=0x7f4ae4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.931+0000 7f4ae2ffd640 1 -- 172.21.15.46:0/3364294193 >> v1:172.21.15.46:6789/0 conn(0x7f4ae40c28c0 legacy=0x7f4ae40c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:49.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.931+0000 7f4ae2ffd640 1 -- 172.21.15.46:0/3364294193 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40cd200 con 0x7f4ae40c2ca0 2024-01-27T13:32:49.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.935+0000 7f4ae2ffd640 1 --2- 172.21.15.46:0/3364294193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c2ca0 0x7f4ae41514f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40ca9f0 tx=0x7f4ad802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770604ecfc4475d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:49.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae27fc640 1 -- 172.21.15.46:0/3364294193 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8030840 con 0x7f4ae40c2ca0 2024-01-27T13:32:49.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae27fc640 1 -- 172.21.15.46:0/3364294193 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad80309a0 con 0x7f4ae40c2ca0 2024-01-27T13:32:49.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae27fc640 1 -- 172.21.15.46:0/3364294193 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8030d30 con 0x7f4ae40c2ca0 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 -- 172.21.15.46:0/3364294193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c2ca0 msgr2=0x7f4ae41514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/3364294193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c2ca0 0x7f4ae41514f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40ca9f0 tx=0x7f4ad802b980 comp rx=0 tx=0).stop 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 -- 172.21.15.46:0/3364294193 shutdown_connections 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/3364294193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c2ca0 0x7f4ae41514f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 -- 172.21.15.46:0/3364294193 >> 172.21.15.46:0/3364294193 conn(0x7f4ae406efe0 msgr2=0x7f4ae406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 -- 172.21.15.46:0/3364294193 shutdown_connections 2024-01-27T13:32:49.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.940+0000 7f4ae9dde640 1 -- 172.21.15.46:0/3364294193 wait complete. 2024-01-27T13:32:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.941+0000 7f4ae9dde640 1 Processor -- start 2024-01-27T13:32:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 -- start start 2024-01-27T13:32:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4ae40c28c0 0x7f4ae4150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ae40c2ca0 0x7f4ae40b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 0x7f4ae40b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae414e670 con 0x7f4ae40c2ca0 2024-01-27T13:32:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41deec0 con 0x7f4ae40c77d0 2024-01-27T13:32:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.942+0000 7f4ae9dde640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae406d870 con 0x7f4ae40c28c0 2024-01-27T13:32:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.943+0000 7f4ae37fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4ae40c28c0 0x7f4ae4150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.943+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 0x7f4ae40b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.943+0000 7f4ae3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 0x7f4ae40b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56288/0 (socket says 172.21.15.46:56288) 2024-01-27T13:32:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.943+0000 7f4ae3fff640 1 -- 172.21.15.46:0/2372091291 learned_addr learned my addr 172.21.15.46:0/2372091291 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:49.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.947+0000 7f4ae3fff640 1 -- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4ae40c28c0 msgr2=0x7f4ae4150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.947+0000 7f4ae3fff640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4ae40c28c0 0x7f4ae4150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.947+0000 7f4ae3fff640 1 -- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ae40c2ca0 msgr2=0x7f4ae40b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:49.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.947+0000 7f4ae3fff640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ae40c2ca0 0x7f4ae40b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:49.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.947+0000 7f4ae3fff640 1 -- 172.21.15.46:0/2372091291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80094d0 con 0x7f4ae40c77d0 2024-01-27T13:32:49.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.950+0000 7f4ae3fff640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 0x7f4ae40b1470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c680 tx=0x7f4adc00cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:49.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.953+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc003b70 con 0x7f4ae40c77d0 2024-01-27T13:32:49.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.953+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc003cd0 con 0x7f4ae40c77d0 2024-01-27T13:32:49.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.953+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc005310 con 0x7f4ae40c77d0 2024-01-27T13:32:49.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.953+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae406d2f0 con 0x7f4ae40c77d0 2024-01-27T13:32:49.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.953+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae414f290 con 0x7f4ae40c77d0 2024-01-27T13:32:49.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.954+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae40cb020 con 0x7f4ae40c77d0 2024-01-27T13:32:49.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.974+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4adc006b50 con 0x7f4ae40c77d0 2024-01-27T13:32:49.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.974+0000 7f4acbfff640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ad006af50 0x7f4ad006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:49.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.974+0000 7f4ae37fe640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ad006af50 0x7f4ad006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:49.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:49.975+0000 7f4ae37fe640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ad006af50 0x7f4ad006d410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40017f0 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:50.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.204+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4adc058ec0 con 0x7f4ae40c77d0 2024-01-27T13:32:50.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.213+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4adc054b00 con 0x7f4ae40c77d0 2024-01-27T13:32:50.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.400+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae40cb020 con 0x7f4ae40c77d0 2024-01-27T13:32:50.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.509+0000 7f4acbfff640 1 -- 172.21.15.46:0/2372091291 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f4ae40cb020 con 0x7f4ae40c77d0 2024-01-27T13:32:50.503 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:50.503 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:49.940719+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:50.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ad006af50 msgr2=0x7f4ad006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:50.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ad006af50 0x7f4ad006d410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40017f0 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 msgr2=0x7f4ae40b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 0x7f4ae40b1470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00c680 tx=0x7f4adc00cb40 comp rx=0 tx=0).stop 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 shutdown_connections 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ad006af50 0x7f4ad006d410 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ae40c77d0 0x7f4ae40b1470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ae40c2ca0 0x7f4ae40b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 --2- 172.21.15.46:0/2372091291 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4ae40c28c0 0x7f4ae4150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 >> 172.21.15.46:0/2372091291 conn(0x7f4ae406efe0 msgr2=0x7f4ae41e3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:50.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 shutdown_connections 2024-01-27T13:32:50.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.512+0000 7f4ae9dde640 1 -- 172.21.15.46:0/2372091291 wait complete. 2024-01-27T13:32:50.516 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-27T13:32:50.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.625+0000 7f373763d640 1 Processor -- start 2024-01-27T13:32:50.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.625+0000 7f373763d640 1 -- start start 2024-01-27T13:32:50.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f373763d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37300c8f00 0x7f37300cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:50.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f373763d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f37300cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f373763d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37300ca9f0 con 0x7f373015cf00 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f373763d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37300cc9c0 con 0x7f37300c8f00 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f373763d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3730159d50 con 0x7f37300c92e0 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f37353d9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37300c8f00 0x7f37300cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.626+0000 7f3734bd8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f37300cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.627+0000 7f3734bd8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f37300cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43648/0 (socket says 172.21.15.46:43648) 2024-01-27T13:32:50.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.627+0000 7f3734bd8640 1 -- 172.21.15.46:0/3988006290 learned_addr learned my addr 172.21.15.46:0/3988006290 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:50.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.629+0000 7f3734bd8640 1 -- 172.21.15.46:0/3988006290 >> v2:172.21.15.78:3300/0 conn(0x7f37300c8f00 msgr2=0x7f37300cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:50.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.629+0000 7f3734bd8640 1 --2- 172.21.15.46:0/3988006290 >> v2:172.21.15.78:3300/0 conn(0x7f37300c8f00 0x7f37300cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.629+0000 7f3734bd8640 1 -- 172.21.15.46:0/3988006290 >> v1:172.21.15.78:6789/0 conn(0x7f373015cf00 legacy=0x7f373015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:50.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.629+0000 7f3734bd8640 1 -- 172.21.15.46:0/3988006290 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300cc6e0 con 0x7f37300c92e0 2024-01-27T13:32:50.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.632+0000 7f3734bd8640 1 --2- 172.21.15.46:0/3988006290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f37300cf550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3720009870 tx=0x7f372002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e70f07527b1b147e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:50.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.636+0000 7f3727fff640 1 -- 172.21.15.46:0/3988006290 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372002f840 con 0x7f37300c92e0 2024-01-27T13:32:50.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.636+0000 7f3727fff640 1 -- 172.21.15.46:0/3988006290 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372002f9a0 con 0x7f37300c92e0 2024-01-27T13:32:50.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.636+0000 7f3727fff640 1 -- 172.21.15.46:0/3988006290 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372002fd30 con 0x7f37300c92e0 2024-01-27T13:32:50.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 -- 172.21.15.46:0/3988006290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 msgr2=0x7f37300cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 --2- 172.21.15.46:0/3988006290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f37300cf550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3720009870 tx=0x7f372002ba20 comp rx=0 tx=0).stop 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 -- 172.21.15.46:0/3988006290 shutdown_connections 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 --2- 172.21.15.46:0/3988006290 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f37300cf550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 --2- 172.21.15.46:0/3988006290 >> v2:172.21.15.78:3300/0 conn(0x7f37300c8f00 0x7f37300cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 -- 172.21.15.46:0/3988006290 >> 172.21.15.46:0/3988006290 conn(0x7f373008afd0 msgr2=0x7f373008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 -- 172.21.15.46:0/3988006290 shutdown_connections 2024-01-27T13:32:50.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.637+0000 7f373763d640 1 -- 172.21.15.46:0/3988006290 wait complete. 2024-01-27T13:32:50.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.638+0000 7f373763d640 1 Processor -- start 2024-01-27T13:32:50.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.638+0000 7f373763d640 1 -- start start 2024-01-27T13:32:50.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.639+0000 7f373763d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37300c8f00 0x7f37300ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:50.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.639+0000 7f373763d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f3730151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:50.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.639+0000 7f373763d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 0x7f37301555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:50.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.639+0000 7f373763d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730154330 con 0x7f373015cf00 2024-01-27T13:32:50.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.639+0000 7f373763d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730157e50 con 0x7f37300c8f00 2024-01-27T13:32:50.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.639+0000 7f373763d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3730151cd0 con 0x7f37300c92e0 2024-01-27T13:32:50.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.640+0000 7f3735bda640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 0x7f37301555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:50.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.640+0000 7f3734bd8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f3730151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:50.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.640+0000 7f37353d9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37300c8f00 0x7f37300ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:50.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.640+0000 7f3735bda640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 0x7f37301555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49552/0 (socket says 172.21.15.46:49552) 2024-01-27T13:32:50.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.640+0000 7f3735bda640 1 -- 172.21.15.46:0/3396425702 learned_addr learned my addr 172.21.15.46:0/3396425702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:50.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.643+0000 7f3735bda640 1 -- 172.21.15.46:0/3396425702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 msgr2=0x7f3730151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:50.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.643+0000 7f3735bda640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f3730151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.643+0000 7f3735bda640 1 -- 172.21.15.46:0/3396425702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37300c8f00 msgr2=0x7f37300ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:50.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.643+0000 7f3735bda640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37300c8f00 0x7f37300ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:50.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.643+0000 7f3735bda640 1 -- 172.21.15.46:0/3396425702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200094d0 con 0x7f373015cf00 2024-01-27T13:32:50.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.646+0000 7f3735bda640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 0x7f37301555e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f372800c7a0 tx=0x7f372800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:50.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.650+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728003b70 con 0x7f373015cf00 2024-01-27T13:32:50.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.650+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3728003cf0 con 0x7f373015cf00 2024-01-27T13:32:50.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.650+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3730154540 con 0x7f373015cf00 2024-01-27T13:32:50.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.650+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728003ea0 con 0x7f373015cf00 2024-01-27T13:32:50.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.650+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3730154b00 con 0x7f373015cf00 2024-01-27T13:32:50.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.651+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373004eb40 con 0x7f373015cf00 2024-01-27T13:32:50.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.670+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f372800aa90 con 0x7f373015cf00 2024-01-27T13:32:50.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.670+0000 7f3725ffb640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371406af20 0x7f371406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:50.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.671+0000 7f37353d9640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371406af20 0x7f371406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:50.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.671+0000 7f37353d9640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371406af20 0x7f371406d3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f372c009aa0 tx=0x7f372c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:50.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.673+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3728058a30 con 0x7f373015cf00 2024-01-27T13:32:50.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:50.929+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3728054d70 con 0x7f373015cf00 2024-01-27T13:32:51.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.110+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3730074410 con 0x7f373015cf00 2024-01-27T13:32:51.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.156+0000 7f3725ffb640 1 -- 172.21.15.46:0/3396425702 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f3728058390 con 0x7f373015cf00 2024-01-27T13:32:51.149 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:51.149 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:49.940719+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371406af20 msgr2=0x7f371406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371406af20 0x7f371406d3e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f372c009aa0 tx=0x7f372c009190 comp rx=0 tx=0).stop 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 msgr2=0x7f37301555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 0x7f37301555e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f372800c7a0 tx=0x7f372800cc60 comp rx=0 tx=0).stop 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 shutdown_connections 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371406af20 0x7f371406d3e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f373015cf00 0x7f37301555e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37300c92e0 0x7f3730151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 --2- 172.21.15.46:0/3396425702 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37300c8f00 0x7f37300ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 >> 172.21.15.46:0/3396425702 conn(0x7f373008afd0 msgr2=0x7f37300cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 shutdown_connections 2024-01-27T13:32:51.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.158+0000 7f373763d640 1 -- 172.21.15.46:0/3396425702 wait complete. 2024-01-27T13:32:51.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-27T13:32:51.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-27T13:32:51.162 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-27T13:32:51.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-27T13:32:51.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-27T13:32:51.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-27T13:32:51.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-27T13:32:51.164 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-27T13:32:51.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.343+0000 7fa1fffff640 1 Processor -- start 2024-01-27T13:32:51.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.343+0000 7fa1fffff640 1 -- start start 2024-01-27T13:32:51.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.344+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.344+0000 7fa1fffff640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f80d9fd0 con 0x7fa1f80d9bf0 2024-01-27T13:32:51.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.344+0000 7fa1fffff640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f8006c90 con 0x7fa1f804bc10 2024-01-27T13:32:51.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.345+0000 7f275bfff640 1 Processor -- start 2024-01-27T13:32:51.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.344+0000 7fa1fffff640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f804dba0 con 0x7fa1f8046170 2024-01-27T13:32:51.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.345+0000 7f8232567640 1 Processor -- start 2024-01-27T13:32:51.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.345+0000 7f275bfff640 1 -- start start 2024-01-27T13:32:51.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f8232567640 1 -- start start 2024-01-27T13:32:51.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7fa1fe7fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f67317e5640 1 Processor -- start 2024-01-27T13:32:51.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f67317e5640 1 -- start start 2024-01-27T13:32:51.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f1b5b11a640 1 Processor -- start 2024-01-27T13:32:51.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7fa1ff7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa1f804bc10 0x7fa1f80edad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:36746/0 (socket says 172.21.15.46:36746) 2024-01-27T13:32:51.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7fa1ff7fe640 1 -- 172.21.15.46:0/2454540952 learned_addr learned my addr 172.21.15.46:0/2454540952 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f1b5b11a640 1 -- start start 2024-01-27T13:32:51.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f275bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f275bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f275c0c6310 0x7f275c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f275bfff640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275c1558d0 con 0x7f275c071b70 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f275bfff640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c072000 con 0x7f275c0c6310 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.346+0000 7f275bfff640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c155b90 con 0x7f275c071790 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f275a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f275c0c6310 0x7f275c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f8232567640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c14f880 0x7f822c0c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f67317e5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6724050e80 0x7f6724045300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f67317e5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f672400e480 0x7f67240de350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f67317e5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6724007230 con 0x7f67240076c0 2024-01-27T13:32:51.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f67317e5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672404bb40 con 0x7f672400e480 2024-01-27T13:32:51.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f67317e5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672404b6e0 con 0x7f6724050e80 2024-01-27T13:32:51.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.347+0000 7f8232567640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f822c06c9c0 0x7f822c06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f3730e44640 1 Processor -- start 2024-01-27T13:32:51.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f8232567640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822c0c5f10 con 0x7f822c0c4400 2024-01-27T13:32:51.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f275a7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f275c0c6310 0x7f275c0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56320/0 (socket says 172.21.15.46:56320) 2024-01-27T13:32:51.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f8232567640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822c06db40 con 0x7f822c06c9c0 2024-01-27T13:32:51.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f8232567640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c0c64f0 con 0x7f822c14f880 2024-01-27T13:32:51.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f275a7fc640 1 -- 172.21.15.46:0/309421679 learned_addr learned my addr 172.21.15.46:0/309421679 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f1b5b11a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1b5406ea80 0x7f1b54156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f1b5b11a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b5406ee60 0x7f1b540c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f3730e44640 1 -- start start 2024-01-27T13:32:51.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f1b5b11a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b54156f90 0x7f1b540c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f1b5b11a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b540c1cc0 con 0x7f1b5406ea80 2024-01-27T13:32:51.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.348+0000 7f275affd640 1 --2- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f1b5b11a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b54156630 con 0x7f1b5406ee60 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f1b5b11a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54156320 con 0x7f1b54156f90 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f3730e44640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f372404ba60 0x7f372404be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f3730e44640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f37240e3090 0x7f37240e3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f3730e44640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3724045450 con 0x7f37240dd3c0 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f3730e44640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3724045fd0 con 0x7f37240e3090 2024-01-27T13:32:51.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.349+0000 7f3730e44640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3724046b70 con 0x7f372404ba60 2024-01-27T13:32:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.351+0000 7f8230d64640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f822c0c4400 0x7f822c0c6670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40370/0 (socket says 172.21.15.46:40370) 2024-01-27T13:32:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.351+0000 7f8230d64640 1 -- 172.21.15.46:0/110684504 learned_addr learned my addr 172.21.15.46:0/110684504 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.351+0000 7fec1b59e640 1 Processor -- start 2024-01-27T13:32:51.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7fec1b59e640 1 -- start start 2024-01-27T13:32:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7f275a7fc640 1 -- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 msgr2=0x7f275c072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7f275a7fc640 1 --2- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7f275a7fc640 1 -- 172.21.15.46:0/309421679 >> v1:172.21.15.46:6789/0 conn(0x7f275c071b70 legacy=0x7f275c159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7f275a7fc640 1 -- 172.21.15.46:0/309421679 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c155e70 con 0x7f275c0c6310 2024-01-27T13:32:51.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7fa1fdffb640 1 -- 172.21.15.46:0/2454540952 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214642157 0 0) 0x7fa1f8006c90 con 0x7fa1f804bc10 2024-01-27T13:32:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.352+0000 7fa1fdffb640 1 -- 172.21.15.46:0/2454540952 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e8003520 con 0x7fa1f804bc10 2024-01-27T13:32:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fec1b59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c1534a0 0x7fec1c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7f8231565640 1 --2- 172.21.15.46:0/110684504 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c14f880 0x7f822c0c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fec1b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec1c06dd50 0x7fec1c153880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fec1b59e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fec1c070430 0x7fec1c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fec1b59e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c06e370 con 0x7fec1c070430 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fec1b59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c159ce0 con 0x7fec1c06dd50 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fec1b59e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c06f240 con 0x7fec1c1534a0 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.353+0000 7fa479fac640 1 Processor -- start 2024-01-27T13:32:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7fa479fac640 1 -- start start 2024-01-27T13:32:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7f1b59917640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b5406ee60 0x7f1b540c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7fa479fac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa46c0d5c30 0x7fa46c0dc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7f672a7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f67240076c0 0x7f67240d4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40376/0 (socket says 172.21.15.46:40376) 2024-01-27T13:32:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7f672a7fc640 1 -- 172.21.15.46:0/3499728224 learned_addr learned my addr 172.21.15.46:0/3499728224 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7fa479fac640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c045cf0 con 0x7fa46c046840 2024-01-27T13:32:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7fa479fac640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c045f90 con 0x7fa46c0066e0 2024-01-27T13:32:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.354+0000 7fa479fac640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c046270 con 0x7fa46c0d5c30 2024-01-27T13:32:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.355+0000 7fa1fe7fc640 1 -- 172.21.15.46:0/2454540952 >> v1:172.21.15.78:6789/0 conn(0x7fa1f804bc10 legacy=0x7fa1f80edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.355+0000 7fa1fe7fc640 1 -- 172.21.15.46:0/2454540952 >> v1:172.21.15.46:6789/0 conn(0x7fa1f80d9bf0 legacy=0x7fa1f8046e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.355+0000 7fa1fe7fc640 1 -- 172.21.15.46:0/2454540952 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8007810 con 0x7fa1f8046170 2024-01-27T13:32:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.355+0000 7f1b59917640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b5406ee60 0x7f1b540c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56322/0 (socket says 172.21.15.46:56322) 2024-01-27T13:32:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.355+0000 7f1b59917640 1 -- 172.21.15.46:0/2398260684 learned_addr learned my addr 172.21.15.46:0/2398260684 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.355+0000 7f275a7fc640 1 --2- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c0c6310 0x7f275c0c5c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f275000b970 tx=0x7f275002c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a690563d81dd1e52 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.358+0000 7f1b5a919640 1 --2- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b54156f90 0x7f1b540c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.358+0000 7fa1fe7fc640 1 --2- 172.21.15.46:0/2454540952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e3bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa200000b60 tx=0x7fa2000a66c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74bdc1fed924a63 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.359+0000 7f1b59917640 1 -- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b54156f90 msgr2=0x7f1b540c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.359+0000 7f1b59917640 1 --2- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b54156f90 0x7f1b540c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.359+0000 7f1b59917640 1 -- 172.21.15.46:0/2398260684 >> v2:172.21.15.46:3300/0 conn(0x7f1b5406ea80 msgr2=0x7f1b54156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.359+0000 7f1b59917640 1 --2- 172.21.15.46:0/2398260684 >> v2:172.21.15.46:3300/0 conn(0x7f1b5406ea80 0x7f1b54156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.359+0000 7f1b59917640 1 -- 172.21.15.46:0/2398260684 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5406f7c0 con 0x7f1b5406ee60 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.360+0000 7f8223fff640 1 -- 172.21.15.46:0/110684504 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210504190 0 0) 0x7f822c0c5f10 con 0x7f822c0c4400 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.360+0000 7f8223fff640 1 -- 172.21.15.46:0/110684504 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8218005730 con 0x7f822c0c4400 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.361+0000 7f8231565640 1 -- 172.21.15.46:0/110684504 >> v2:172.21.15.46:3300/0 conn(0x7f822c06c9c0 msgr2=0x7f822c06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.361+0000 7f8231565640 1 --2- 172.21.15.46:0/110684504 >> v2:172.21.15.46:3300/0 conn(0x7f822c06c9c0 0x7f822c06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.361+0000 7f8231565640 1 -- 172.21.15.46:0/110684504 >> v1:172.21.15.46:6789/0 conn(0x7f822c0c4400 legacy=0x7f822c0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.361+0000 7f8231565640 1 -- 172.21.15.46:0/110684504 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c0c6250 con 0x7f822c14f880 2024-01-27T13:32:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.364+0000 7f672bfff640 1 --2- 172.21.15.46:0/3499728224 >> v2:172.21.15.46:3300/0 conn(0x7f672400e480 0x7f67240de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.364+0000 7f2759ffb640 1 -- 172.21.15.46:0/309421679 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750034440 con 0x7f275c0c6310 2024-01-27T13:32:51.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.364+0000 7f2759ffb640 1 -- 172.21.15.46:0/309421679 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500345a0 con 0x7f275c0c6310 2024-01-27T13:32:51.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.364+0000 7f2759ffb640 1 -- 172.21.15.46:0/309421679 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750034910 con 0x7f275c0c6310 2024-01-27T13:32:51.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.364+0000 7f672affd640 1 --2- 172.21.15.46:0/3499728224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6724050e80 0x7f6724045300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 -- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c0c6310 msgr2=0x7f275c0c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 --2- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c0c6310 0x7f275c0c5c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f275000b970 tx=0x7f275002c230 comp rx=0 tx=0).stop 2024-01-27T13:32:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 -- 172.21.15.46:0/309421679 shutdown_connections 2024-01-27T13:32:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 --2- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c0c6310 0x7f275c0c5c60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 --2- 172.21.15.46:0/309421679 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 -- 172.21.15.46:0/309421679 >> 172.21.15.46:0/309421679 conn(0x7f275c06ee40 msgr2=0x7f275c06f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 -- 172.21.15.46:0/309421679 shutdown_connections 2024-01-27T13:32:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f275bfff640 1 -- 172.21.15.46:0/309421679 wait complete. 2024-01-27T13:32:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f372b7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f37240dd3c0 0x7f3724046460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:36748/0 (socket says 172.21.15.46:36748) 2024-01-27T13:32:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.365+0000 7f372b7fe640 1 -- 172.21.15.46:0/3519233137 learned_addr learned my addr 172.21.15.46:0/3519233137 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.366+0000 7f8231565640 1 --2- 172.21.15.46:0/110684504 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c14f880 0x7f822c0c20f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f822800a940 tx=0x7f822802bb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=758cad98f7813a0c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 Processor -- start 2024-01-27T13:32:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 -- start start 2024-01-27T13:32:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f672bfff640 1 -- 172.21.15.46:0/3499728224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6724050e80 msgr2=0x7f6724045300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f672bfff640 1 --2- 172.21.15.46:0/3499728224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6724050e80 0x7f6724045300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f672bfff640 1 -- 172.21.15.46:0/3499728224 >> v1:172.21.15.46:6789/0 conn(0x7f67240076c0 legacy=0x7f67240d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f672bfff640 1 -- 172.21.15.46:0/3499728224 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6724045840 con 0x7f672400e480 2024-01-27T13:32:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c071b70 0x7f275c140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0c6310 0x7f275c140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0cba50 con 0x7f275c0c6310 2024-01-27T13:32:51.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0c8b80 con 0x7f275c071b70 2024-01-27T13:32:51.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f275bfff640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c1ef440 con 0x7f275c071790 2024-01-27T13:32:51.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.367+0000 7f372affd640 1 --2- 172.21.15.46:0/3519233137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f372404ba60 0x7f372404be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.369+0000 7f1b59917640 1 --2- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5406ee60 0x7f1b540c69a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b5406f460 tx=0x7f1b5002fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a11da3b8bd6da46 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.371+0000 7f672bfff640 1 --2- 172.21.15.46:0/3499728224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f672400e480 0x7f67240de350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f672c04fcc0 tx=0x7f672c0a6610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b857629c0415af server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.373+0000 7f372affd640 1 -- 172.21.15.46:0/3519233137 >> v2:172.21.15.46:3300/0 conn(0x7f37240e3090 msgr2=0x7f37240e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.373+0000 7f372affd640 1 --2- 172.21.15.46:0/3519233137 >> v2:172.21.15.46:3300/0 conn(0x7f37240e3090 0x7f37240e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.373+0000 7f372affd640 1 -- 172.21.15.46:0/3519233137 >> v1:172.21.15.78:6789/0 conn(0x7f37240dd3c0 legacy=0x7f3724046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.373+0000 7f372affd640 1 -- 172.21.15.46:0/3519233137 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240dd7a0 con 0x7f372404ba60 2024-01-27T13:32:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.374+0000 7fa1fdffb640 1 -- 172.21.15.46:0/2454540952 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000ab7d0 con 0x7fa1f8046170 2024-01-27T13:32:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.374+0000 7fa1fdffb640 1 -- 172.21.15.46:0/2454540952 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2000a9050 con 0x7fa1f8046170 2024-01-27T13:32:51.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.374+0000 7fa1fdffb640 1 -- 172.21.15.46:0/2454540952 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000abbf0 con 0x7fa1f8046170 2024-01-27T13:32:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.374+0000 7fec13fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec1c06dd50 0x7fec1c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 -- 172.21.15.46:0/2454540952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 msgr2=0x7fa1f80e3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 --2- 172.21.15.46:0/2454540952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e3bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa200000b60 tx=0x7fa2000a66c0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 -- 172.21.15.46:0/2454540952 shutdown_connections 2024-01-27T13:32:51.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 --2- 172.21.15.46:0/2454540952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e3bd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 -- 172.21.15.46:0/2454540952 >> 172.21.15.46:0/2454540952 conn(0x7fa1f8051290 msgr2=0x7fa1f80516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 -- 172.21.15.46:0/2454540952 shutdown_connections 2024-01-27T13:32:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fa1fffff640 1 -- 172.21.15.46:0/2454540952 wait complete. 2024-01-27T13:32:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fec13fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec1c06dd50 0x7fec1c153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56326/0 (socket says 172.21.15.46:56326) 2024-01-27T13:32:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.375+0000 7fec13fff640 1 -- 172.21.15.46:0/4201753829 learned_addr learned my addr 172.21.15.46:0/4201753829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.376+0000 7fa478faa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa46c0d5c30 0x7fa46c0dc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.376+0000 7fa1fffff640 1 Processor -- start 2024-01-27T13:32:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.376+0000 7fa1fffff640 1 -- start start 2024-01-27T13:32:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7f372affd640 1 --2- 172.21.15.46:0/3519233137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f372404ba60 0x7f372404be80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37180097a0 tx=0x7f371802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c17425325b2cbf server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa478faa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa46c0d5c30 0x7fa46c0dc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56330/0 (socket says 172.21.15.46:56330) 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa478faa640 1 -- 172.21.15.46:0/3050233129 learned_addr learned my addr 172.21.15.46:0/3050233129 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f804bc10 0x7fa1f804fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa1fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80d9bf0 0x7fa1f8050080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa1fffff640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80e2950 con 0x7fa1f80d9bf0 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa1fffff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80d1400 con 0x7fa1f804bc10 2024-01-27T13:32:51.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.377+0000 7fa1fffff640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80d16e0 con 0x7fa1f8046170 2024-01-27T13:32:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.379+0000 7fec13fff640 1 -- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c1534a0 msgr2=0x7fec1c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.379+0000 7fec13fff640 1 --2- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c1534a0 0x7fec1c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.379+0000 7fec13fff640 1 -- 172.21.15.46:0/4201753829 >> v2:172.21.15.46:3300/0 conn(0x7fec1c070430 msgr2=0x7fec1c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.379+0000 7fec13fff640 1 --2- 172.21.15.46:0/4201753829 >> v2:172.21.15.46:3300/0 conn(0x7fec1c070430 0x7fec1c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.379+0000 7fec13fff640 1 -- 172.21.15.46:0/4201753829 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c06ec80 con 0x7fec1c06dd50 2024-01-27T13:32:51.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.381+0000 7f275b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0c6310 0x7f275c140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.382+0000 7f275affd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.382+0000 7f275affd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c0acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43722/0 (socket says 172.21.15.46:43722) 2024-01-27T13:32:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.382+0000 7f275affd640 1 -- 172.21.15.46:0/1882159115 learned_addr learned my addr 172.21.15.46:0/1882159115 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.383+0000 7fa1feffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.383+0000 7fa478faa640 1 -- 172.21.15.46:0/3050233129 >> v1:172.21.15.78:6789/0 conn(0x7fa46c0066e0 legacy=0x7fa46c0e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.383+0000 7fa478faa640 1 -- 172.21.15.46:0/3050233129 >> v1:172.21.15.46:6789/0 conn(0x7fa46c046840 legacy=0x7fa46c046d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.383+0000 7fa478faa640 1 -- 172.21.15.46:0/3050233129 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0dbb40 con 0x7fa46c0d5c30 2024-01-27T13:32:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.383+0000 7fa1feffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43730/0 (socket says 172.21.15.46:43730) 2024-01-27T13:32:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.383+0000 7fa1feffd640 1 -- 172.21.15.46:0/2836418675 learned_addr learned my addr 172.21.15.46:0/2836418675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f1b59116640 1 -- 172.21.15.46:0/2398260684 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50030b70 con 0x7f1b5406ee60 2024-01-27T13:32:51.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f1b59116640 1 -- 172.21.15.46:0/2398260684 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50030cd0 con 0x7f1b5406ee60 2024-01-27T13:32:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f1b59116640 1 -- 172.21.15.46:0/2398260684 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50038660 con 0x7f1b5406ee60 2024-01-27T13:32:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f6729ffb640 1 -- 172.21.15.46:0/3499728224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0ab7d0 con 0x7f672400e480 2024-01-27T13:32:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f6729ffb640 1 -- 172.21.15.46:0/3499728224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c0a9050 con 0x7f672400e480 2024-01-27T13:32:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f6729ffb640 1 -- 172.21.15.46:0/3499728224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0abbd0 con 0x7f672400e480 2024-01-27T13:32:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.384+0000 7f8223fff640 1 -- 172.21.15.46:0/110684504 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822802c920 con 0x7f822c14f880 2024-01-27T13:32:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8223fff640 1 -- 172.21.15.46:0/110684504 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822802ca80 con 0x7f822c14f880 2024-01-27T13:32:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8223fff640 1 -- 172.21.15.46:0/110684504 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822802ce10 con 0x7f822c14f880 2024-01-27T13:32:51.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5406ee60 msgr2=0x7f1b540c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5406ee60 0x7f1b540c69a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b5406f460 tx=0x7f1b5002fdc0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2398260684 shutdown_connections 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b54156f90 0x7f1b540c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2398260684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5406ee60 0x7f1b540c69a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2398260684 >> v2:172.21.15.46:3300/0 conn(0x7f1b5406ea80 0x7f1b54156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2398260684 >> 172.21.15.46:0/2398260684 conn(0x7f1b540cbff0 msgr2=0x7f1b540cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2398260684 shutdown_connections 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2398260684 wait complete. 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f67317e5640 1 -- 172.21.15.46:0/3499728224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f672400e480 msgr2=0x7f67240de350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f67317e5640 1 --2- 172.21.15.46:0/3499728224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f672400e480 0x7f67240de350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f672c04fcc0 tx=0x7f672c0a6610 comp rx=0 tx=0).stop 2024-01-27T13:32:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8232567640 1 -- 172.21.15.46:0/110684504 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c14f880 msgr2=0x7f822c0c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8232567640 1 --2- 172.21.15.46:0/110684504 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c14f880 0x7f822c0c20f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f822800a940 tx=0x7f822802bb70 comp rx=0 tx=0).stop 2024-01-27T13:32:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8232567640 1 -- 172.21.15.46:0/110684504 shutdown_connections 2024-01-27T13:32:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8232567640 1 --2- 172.21.15.46:0/110684504 >> v2:172.21.15.46:3300/0 conn(0x7f822c06c9c0 0x7f822c06cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8232567640 1 --2- 172.21.15.46:0/110684504 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c14f880 0x7f822c0c20f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f8232567640 1 -- 172.21.15.46:0/110684504 >> 172.21.15.46:0/110684504 conn(0x7f822c0c76f0 msgr2=0x7f822c0c7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f67317e5640 1 -- 172.21.15.46:0/3499728224 shutdown_connections 2024-01-27T13:32:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f67317e5640 1 --2- 172.21.15.46:0/3499728224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f672400e480 0x7f67240de350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f67317e5640 1 --2- 172.21.15.46:0/3499728224 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6724050e80 0x7f6724045300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.385+0000 7f67317e5640 1 -- 172.21.15.46:0/3499728224 >> 172.21.15.46:0/3499728224 conn(0x7f6724050360 msgr2=0x7f6724050770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7f67317e5640 1 -- 172.21.15.46:0/3499728224 shutdown_connections 2024-01-27T13:32:51.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7f8232567640 1 -- 172.21.15.46:0/110684504 shutdown_connections 2024-01-27T13:32:51.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7f67317e5640 1 -- 172.21.15.46:0/3499728224 wait complete. 2024-01-27T13:32:51.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7f8232567640 1 -- 172.21.15.46:0/110684504 wait complete. 2024-01-27T13:32:51.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7fec13fff640 1 --2- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c06dd50 0x7fec1c153880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0ccdf0 tx=0x7fec0402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb532057cf9780d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7fa478faa640 1 --2- 172.21.15.46:0/3050233129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c0dc340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa468009870 tx=0x7fa46802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa76f9bd48544d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7f1b5b11a640 1 Processor -- start 2024-01-27T13:32:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.386+0000 7f1b5b11a640 1 -- start start 2024-01-27T13:32:51.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f67317e5640 1 Processor -- start 2024-01-27T13:32:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f67317e5640 1 -- start start 2024-01-27T13:32:51.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f8232567640 1 Processor -- start 2024-01-27T13:32:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f1b5b11a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b5406ea80 0x7f1b54159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f1b5b11a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b5406ee60 0x7f1b541eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f8232567640 1 -- start start 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f1b5b11a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b54156f90 0x7f1b541eb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f1b5b11a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5415a770 con 0x7f1b5406ee60 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f1b5b11a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541ea900 con 0x7f1b54156f90 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.387+0000 7f1b5b11a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5414c2c0 con 0x7f1b5406ea80 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f275affd640 1 -- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c071b70 msgr2=0x7f275c140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f275affd640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f275c071b70 0x7f275c140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f275affd640 1 -- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0c6310 msgr2=0x7f275c140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f275affd640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f275c0c6310 0x7f275c140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f275affd640 1 -- 172.21.15.46:0/1882159115 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500094d0 con 0x7f275c071790 2024-01-27T13:32:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f67317e5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67240076c0 0x7f6724178980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f67317e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f672400e480 0x7f67240d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f67317e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6724050e80 0x7f67240496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f67317e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67240bcc50 con 0x7f6724050e80 2024-01-27T13:32:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f8232567640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c06c9c0 0x7f822c148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f67317e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724048920 con 0x7f672400e480 2024-01-27T13:32:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f67317e5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6724178ec0 con 0x7f67240076c0 2024-01-27T13:32:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f8232567640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c0c4400 0x7f822c155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f8232567640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f822c14f880 0x7f822c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f8232567640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c1473e0 con 0x7f822c14f880 2024-01-27T13:32:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f8232567640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c152df0 con 0x7f822c06c9c0 2024-01-27T13:32:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7f8232567640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c1538a0 con 0x7f822c0c4400 2024-01-27T13:32:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.388+0000 7fa1fe7fc640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f804bc10 0x7fa1f804fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.392+0000 7fa1feffd640 1 -- 172.21.15.46:0/2836418675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f804bc10 msgr2=0x7fa1f804fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.392+0000 7fa1feffd640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f804bc10 0x7fa1f804fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.392+0000 7fa1feffd640 1 -- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80d9bf0 msgr2=0x7fa1f8050080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.392+0000 7fa1feffd640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa1f80d9bf0 0x7fa1f8050080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.392+0000 7fa1feffd640 1 -- 172.21.15.46:0/2836418675 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000673b0 con 0x7fa1f8046170 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.393+0000 7f372a7fc640 1 -- 172.21.15.46:0/3519233137 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718031830 con 0x7f372404ba60 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.393+0000 7f372a7fc640 1 -- 172.21.15.46:0/3519233137 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718031990 con 0x7f372404ba60 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.393+0000 7f372a7fc640 1 -- 172.21.15.46:0/3519233137 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718031d20 con 0x7f372404ba60 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 -- 172.21.15.46:0/3519233137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f372404ba60 msgr2=0x7f372404be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 --2- 172.21.15.46:0/3519233137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f372404ba60 0x7f372404be80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37180097a0 tx=0x7f371802b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 -- 172.21.15.46:0/3519233137 shutdown_connections 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 --2- 172.21.15.46:0/3519233137 >> v2:172.21.15.46:3300/0 conn(0x7f37240e3090 0x7f37240e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 --2- 172.21.15.46:0/3519233137 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f372404ba60 0x7f372404be80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 -- 172.21.15.46:0/3519233137 >> 172.21.15.46:0/3519233137 conn(0x7f3724050180 msgr2=0x7f3724050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 -- 172.21.15.46:0/3519233137 shutdown_connections 2024-01-27T13:32:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.394+0000 7f3730e44640 1 -- 172.21.15.46:0/3519233137 wait complete. 2024-01-27T13:32:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.395+0000 7fa4737fe640 1 -- 172.21.15.46:0/3050233129 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468030860 con 0x7fa46c0d5c30 2024-01-27T13:32:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.395+0000 7fa4737fe640 1 -- 172.21.15.46:0/3050233129 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4680309c0 con 0x7fa46c0d5c30 2024-01-27T13:32:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.395+0000 7fa4737fe640 1 -- 172.21.15.46:0/3050233129 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468030d50 con 0x7fa46c0d5c30 2024-01-27T13:32:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.395+0000 7f3730e44640 1 Processor -- start 2024-01-27T13:32:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.395+0000 7f3730e44640 1 -- start start 2024-01-27T13:32:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 -- 172.21.15.46:0/3050233129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 msgr2=0x7fa46c0dc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 --2- 172.21.15.46:0/3050233129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c0dc340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa468009870 tx=0x7fa46802b9a0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 -- 172.21.15.46:0/3050233129 shutdown_connections 2024-01-27T13:32:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 --2- 172.21.15.46:0/3050233129 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c0dc340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 -- 172.21.15.46:0/3050233129 >> 172.21.15.46:0/3050233129 conn(0x7fa46c0505d0 msgr2=0x7fa46c0509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 -- 172.21.15.46:0/3050233129 shutdown_connections 2024-01-27T13:32:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7fa479fac640 1 -- 172.21.15.46:0/3050233129 wait complete. 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7f3730e44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f372404ba60 0x7f37240ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7f3730e44640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37240dd3c0 0x7f37240d8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7f3730e44640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37240e3090 0x7f37240d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7f3730e44640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240e24f0 con 0x7f37240e3090 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7f3730e44640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372417c7e0 con 0x7f372404ba60 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.396+0000 7f3730e44640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240e26d0 con 0x7f37240dd3c0 2024-01-27T13:32:51.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.397+0000 7fa479fac640 1 Processor -- start 2024-01-27T13:32:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.397+0000 7fa479fac640 1 -- start start 2024-01-27T13:32:51.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.397+0000 7f275affd640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c0acb20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f274c00d5f0 tx=0x7f274c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa479fac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa46c0066e0 0x7fa46c178d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa479fac640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa46c046840 0x7fa46c175770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa479fac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa479fac640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c04f950 con 0x7fa46c0066e0 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa479fac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c1792b0 con 0x7fa46c0d5c30 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa479fac640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c050400 con 0x7fa46c046840 2024-01-27T13:32:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.398+0000 7fa1feffd640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e7010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c400 tx=0x7fa1f400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.400+0000 7fec19d9b640 1 -- 172.21.15.46:0/4201753829 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04030860 con 0x7fec1c06dd50 2024-01-27T13:32:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.400+0000 7fec19d9b640 1 -- 172.21.15.46:0/4201753829 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec040309c0 con 0x7fec1c06dd50 2024-01-27T13:32:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.400+0000 7fec19d9b640 1 -- 172.21.15.46:0/4201753829 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04030d50 con 0x7fec1c06dd50 2024-01-27T13:32:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.400+0000 7f1b5a118640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b5406ea80 0x7f1b54159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7f672affd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67240076c0 0x7f6724178980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7f1b5a919640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b54156f90 0x7f1b541eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 -- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c06dd50 msgr2=0x7fec1c153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 --2- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c06dd50 0x7fec1c153880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0ccdf0 tx=0x7fec0402b9a0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 -- 172.21.15.46:0/4201753829 shutdown_connections 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 --2- 172.21.15.46:0/4201753829 >> v2:172.21.15.46:3300/0 conn(0x7fec1c070430 0x7fec1c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 --2- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c06dd50 0x7fec1c153880 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 --2- 172.21.15.46:0/4201753829 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c1534a0 0x7fec1c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 -- 172.21.15.46:0/4201753829 >> 172.21.15.46:0/4201753829 conn(0x7fec1c0cbff0 msgr2=0x7fec1c0cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 -- 172.21.15.46:0/4201753829 shutdown_connections 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7fec1b59e640 1 -- 172.21.15.46:0/4201753829 wait complete. 2024-01-27T13:32:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7f1b5a919640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b54156f90 0x7f1b541eb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56366/0 (socket says 172.21.15.46:56366) 2024-01-27T13:32:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.401+0000 7f1b5a919640 1 -- 172.21.15.46:0/2856776294 learned_addr learned my addr 172.21.15.46:0/2856776294 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.402+0000 7f672affd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67240076c0 0x7f6724178980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43748/0 (socket says 172.21.15.46:43748) 2024-01-27T13:32:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.402+0000 7f672affd640 1 -- 172.21.15.46:0/2675182328 learned_addr learned my addr 172.21.15.46:0/2675182328 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.402+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f372404ba60 0x7f37240ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 Processor -- start 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 -- start start 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c06dd50 0x7fec1c1f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c070430 0x7fec1c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec1c1534a0 0x7fec1c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c156740 con 0x7fec1c1534a0 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c151520 con 0x7fec1c070430 2024-01-27T13:32:51.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7fec1b59e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1f31f0 con 0x7fec1c06dd50 2024-01-27T13:32:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7f372b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f372404ba60 0x7f37240ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56394/0 (socket says 172.21.15.46:56394) 2024-01-27T13:32:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.403+0000 7f372b7fe640 1 -- 172.21.15.46:0/681782968 learned_addr learned my addr 172.21.15.46:0/681782968 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.407+0000 7f1b5a919640 1 -- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b5406ea80 msgr2=0x7f1b54159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.407+0000 7f1b5a919640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b5406ea80 0x7f1b54159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.407+0000 7f1b5a919640 1 -- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b5406ee60 msgr2=0x7f1b541eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.407+0000 7f1b5a919640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b5406ee60 0x7f1b541eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.407+0000 7f672a7fc640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f672400e480 0x7f67240d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.407+0000 7f1b5a919640 1 -- 172.21.15.46:0/2856776294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500094d0 con 0x7f1b54156f90 2024-01-27T13:32:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.409+0000 7f672affd640 1 -- 172.21.15.46:0/2675182328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f672400e480 msgr2=0x7f67240d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.409+0000 7f672affd640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f672400e480 0x7f67240d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.409+0000 7f672affd640 1 -- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6724050e80 msgr2=0x7f67240496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.409+0000 7f672affd640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6724050e80 0x7f67240496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.409+0000 7f672affd640 1 -- 172.21.15.46:0/2675182328 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0673b0 con 0x7f67240076c0 2024-01-27T13:32:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.411+0000 7f372b7fe640 1 -- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37240dd3c0 msgr2=0x7f37240d8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.411+0000 7f372b7fe640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f37240dd3c0 0x7f37240d8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.411+0000 7f372b7fe640 1 -- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37240e3090 msgr2=0x7f37240d87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.411+0000 7f372b7fe640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f37240e3090 0x7f37240d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.411+0000 7f372b7fe640 1 -- 172.21.15.46:0/681782968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718009400 con 0x7f372404ba60 2024-01-27T13:32:51.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.415+0000 7f1b5a919640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b54156f90 0x7f1b541eb340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c540 tx=0x7f1b4400ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.416+0000 7f8230d64640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c0c4400 0x7f822c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.418+0000 7f8231565640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c06c9c0 0x7f822c148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.418+0000 7f8230d64640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c0c4400 0x7f822c155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43758/0 (socket says 172.21.15.46:43758) 2024-01-27T13:32:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7f8230d64640 1 -- 172.21.15.46:0/3808101651 learned_addr learned my addr 172.21.15.46:0/3808101651 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7fec1a59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c06dd50 0x7fec1c1f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40052d0 con 0x7fa1f8046170 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4005430 con 0x7fa1f8046170 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003830 con 0x7fa1f8046170 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f80d19c0 con 0x7fa1f8046170 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.419+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f80e4090 con 0x7fa1f8046170 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.420+0000 7f672affd640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67240076c0 0x7f6724178980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c7f0 tx=0x7f671c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.420+0000 7fec1a59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c06dd50 0x7fec1c1f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43784/0 (socket says 172.21.15.46:43784) 2024-01-27T13:32:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.420+0000 7fec1a59c640 1 -- 172.21.15.46:0/884075465 learned_addr learned my addr 172.21.15.46:0/884075465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.420+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1f80071c0 con 0x7fa1f8046170 2024-01-27T13:32:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.420+0000 7fa4797ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.421+0000 7fa4797ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c168230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56404/0 (socket says 172.21.15.46:56404) 2024-01-27T13:32:51.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.421+0000 7fa4797ab640 1 -- 172.21.15.46:0/3296113193 learned_addr learned my addr 172.21.15.46:0/3296113193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.421+0000 7fec1ad9d640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec1c1534a0 0x7fec1c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.422+0000 7fa478faa640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa46c0066e0 0x7fa46c178d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.423+0000 7f8231d66640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f822c14f880 0x7f822c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.424+0000 7f8231565640 1 -- 172.21.15.46:0/3808101651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c0c4400 msgr2=0x7f822c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.424+0000 7f8231565640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f822c0c4400 0x7f822c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.424+0000 7f8231565640 1 -- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f822c14f880 msgr2=0x7f822c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.424+0000 7f8231565640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f822c14f880 0x7f822c1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.424+0000 7f8231565640 1 -- 172.21.15.46:0/3808101651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822800a5a0 con 0x7f822c06c9c0 2024-01-27T13:32:51.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.424+0000 7f372b7fe640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f372404ba60 0x7f37240ced40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f372000c4a0 tx=0x7f372000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.428+0000 7fec1a59c640 1 -- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c070430 msgr2=0x7fec1c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.428+0000 7fec1a59c640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec1c070430 0x7fec1c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.428+0000 7fec1a59c640 1 -- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec1c1534a0 msgr2=0x7fec1c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.428+0000 7fec1a59c640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec1c1534a0 0x7fec1c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.428+0000 7fec1a59c640 1 -- 172.21.15.46:0/884075465 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040094d0 con 0x7fec1c06dd50 2024-01-27T13:32:51.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.428+0000 7f8231565640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c06c9c0 0x7f822c148f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8228033000 tx=0x7f82280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.434+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004220 con 0x7f1b54156f90 2024-01-27T13:32:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.434+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44004380 con 0x7f1b54156f90 2024-01-27T13:32:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.434+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003850 con 0x7f1b54156f90 2024-01-27T13:32:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.434+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b54157a30 con 0x7f1b54156f90 2024-01-27T13:32:51.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.434+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5415a470 con 0x7f1b54156f90 2024-01-27T13:32:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.434+0000 7fec1a59c640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c06dd50 0x7fec1c1f2cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00b4d0 tx=0x7fec0c00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.435+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b540c1420 con 0x7f1b54156f90 2024-01-27T13:32:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.436+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0125f0 con 0x7f275c071790 2024-01-27T13:32:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.436+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c1ef6e0 con 0x7f275c071790 2024-01-27T13:32:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.437+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c1efca0 con 0x7f275c071790 2024-01-27T13:32:51.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.437+0000 7fa473fff640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa46c046840 0x7fa46c175770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.437+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c012750 con 0x7f275c071790 2024-01-27T13:32:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.437+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0125f0 con 0x7f275c071790 2024-01-27T13:32:51.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.437+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f273c001030 con 0x7f275c071790 2024-01-27T13:32:51.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.439+0000 7fa4797ab640 1 -- 172.21.15.46:0/3296113193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa46c046840 msgr2=0x7fa46c175770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.439+0000 7fa4797ab640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa46c046840 0x7fa46c175770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.439+0000 7fa4797ab640 1 -- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa46c0066e0 msgr2=0x7fa46c178d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.439+0000 7fa4797ab640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa46c0066e0 0x7fa46c178d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.439+0000 7fa4797ab640 1 -- 172.21.15.46:0/3296113193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680094d0 con 0x7fa46c0d5c30 2024-01-27T13:32:51.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.440+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720005ce0 con 0x7f372404ba60 2024-01-27T13:32:51.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.440+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3720005e40 con 0x7f372404ba60 2024-01-27T13:32:51.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.440+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720007270 con 0x7f372404ba60 2024-01-27T13:32:51.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.440+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372417ccd0 con 0x7f372404ba60 2024-01-27T13:32:51.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.440+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37240e2920 con 0x7f372404ba60 2024-01-27T13:32:51.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.441+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37240351b0 con 0x7f372404ba60 2024-01-27T13:32:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.443+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c004220 con 0x7f67240076c0 2024-01-27T13:32:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.443+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0043a0 con 0x7f67240076c0 2024-01-27T13:32:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.444+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c003850 con 0x7f67240076c0 2024-01-27T13:32:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.444+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672404f190 con 0x7f67240076c0 2024-01-27T13:32:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.444+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672404f730 con 0x7f67240076c0 2024-01-27T13:32:51.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.445+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6724006ec0 con 0x7f67240076c0 2024-01-27T13:32:51.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.450+0000 7fa4797ab640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c168230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4740749c0 tx=0x7fa47406cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.452+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228040650 con 0x7f822c06c9c0 2024-01-27T13:32:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.452+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82280407b0 con 0x7f822c06c9c0 2024-01-27T13:32:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.452+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228040b60 con 0x7f822c06c9c0 2024-01-27T13:32:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.452+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c153b40 con 0x7f822c06c9c0 2024-01-27T13:32:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.453+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c154100 con 0x7f822c06c9c0 2024-01-27T13:32:51.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.453+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f822c067ab0 con 0x7f822c06c9c0 2024-01-27T13:32:51.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.533+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa1f4003990 con 0x7fa1f8046170 2024-01-27T13:32:51.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.533+0000 7fa1e77fe640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa1ec06af20 0x7fa1ec06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.533+0000 7fa1fe7fc640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa1ec06af20 0x7fa1ec06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.534+0000 7fa1fe7fc640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa1ec06af20 0x7fa1ec06d3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800ef00 tx=0x7fa20006e030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.542+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa1f40580e0 con 0x7fa1f8046170 2024-01-27T13:32:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fa1e77fe640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7fa1ec074780 0x7fa1ec076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 --> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1ec0772f0 con 0x7fa1ec074780 2024-01-27T13:32:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f37200073d0 con 0x7f372404ba60 2024-01-27T13:32:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fa1ff7fe640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7fa1ec074780 0x7fa1ec076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c010870 con 0x7fec1c06dd50 2024-01-27T13:32:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fa1ff7fe640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7fa1ec074780 0x7fa1ec076c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7f3717fff640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371006af00 0x7f371006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c0109d0 con 0x7fec1c06dd50 2024-01-27T13:32:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c150830 con 0x7fec1c06dd50 2024-01-27T13:32:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c010d80 con 0x7fec1c06dd50 2024-01-27T13:32:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c156990 con 0x7fec1c06dd50 2024-01-27T13:32:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.543+0000 7f372affd640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371006af00 0x7f371006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.544+0000 7f372affd640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371006af00 0x7f371006d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3718036000 tx=0x7f3718030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.544+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== osd.3 v2:172.21.15.46:6818/3527109404 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa1ec0772f0 con 0x7fa1ec074780 2024-01-27T13:32:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.544+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec1c0c81e0 con 0x7fec1c06dd50 2024-01-27T13:32:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.548+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3720057f00 con 0x7f372404ba60 2024-01-27T13:32:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.548+0000 7f3717fff640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7f37100746e0 0x7f3710076b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.548+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 --> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3710077250 con 0x7f37100746e0 2024-01-27T13:32:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.549+0000 7f372bfff640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7f37100746e0 0x7f3710076b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.549+0000 7f372bfff640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7f37100746e0 0x7f3710076b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.550+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== osd.4 v2:172.21.15.78:6808/3834088265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3710077250 con 0x7f37100746e0 2024-01-27T13:32:51.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.557+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f671c003bc0 con 0x7f67240076c0 2024-01-27T13:32:51.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.557+0000 7f67137fe640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f671806af50 0x7f671806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.557+0000 7f672a7fc640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f671806af50 0x7f671806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.558+0000 7f672a7fc640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f671806af50 0x7f671806d410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6724006870 tx=0x7f6720009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.558+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 --> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa1f8046640 con 0x7fa1ec074780 2024-01-27T13:32:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1e77fe640 1 -- 172.21.15.46:0/2836418675 <== osd.3 v2:172.21.15.46:6818/3527109404 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa1f0005890 con 0x7fa1ec074780 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7fa1ec074780 msgr2=0x7fa1ec076c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7fa1ec074780 0x7fa1ec076c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa1ec06af20 msgr2=0x7fa1ec06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa1ec06af20 0x7fa1ec06d3e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800ef00 tx=0x7fa20006e030 comp rx=0 tx=0).stop 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 msgr2=0x7fa1f80e7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 --2- 172.21.15.46:0/2836418675 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fa1f8046170 0x7fa1f80e7010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c400 tx=0x7fa1f400c8c0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1ff7fe640 1 -- 172.21.15.46:0/2836418675 reap_dead start 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 shutdown_connections 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 >> 172.21.15.46:0/2836418675 conn(0x7fa1f8051290 msgr2=0x7fa1f80ddad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 shutdown_connections 2024-01-27T13:32:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.559+0000 7fa1fffff640 1 -- 172.21.15.46:0/2836418675 wait complete. 2024-01-27T13:32:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.560+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f671c058dd0 con 0x7f67240076c0 2024-01-27T13:32:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.560+0000 7f67137fe640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7f67180747b0 0x7f6718076c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.560+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 --> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6718077320 con 0x7f67180747b0 2024-01-27T13:32:51.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.560+0000 7f672bfff640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7f67180747b0 0x7f6718076c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.560+0000 7f672bfff640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7f67180747b0 0x7f6718076c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.561+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== osd.2 v2:172.21.15.46:6826/2828306015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6718077320 con 0x7f67180747b0 2024-01-27T13:32:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.564+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3720054240 con 0x7f372404ba60 2024-01-27T13:32:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.564+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1b440039b0 con 0x7f1b54156f90 2024-01-27T13:32:51.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.564+0000 7f1b4affd640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b3806aed0 0x7f1b3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.565+0000 7f1b5a118640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b3806aed0 0x7f1b3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.565+0000 7f1b5a118640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b3806aed0 0x7f1b3806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00a400 tx=0x7f1b4c00d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.566+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 --> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3724045980 con 0x7f37100746e0 2024-01-27T13:32:51.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.566+0000 7f3717fff640 1 -- 172.21.15.46:0/681782968 <== osd.4 v2:172.21.15.78:6808/3834088265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f372c04f940 con 0x7f37100746e0 2024-01-27T13:32:51.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7f37100746e0 msgr2=0x7f3710076b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7f37100746e0 0x7f3710076b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371006af00 msgr2=0x7f371006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f371006af00 0x7f371006d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3718036000 tx=0x7f3718030000 comp rx=0 tx=0).stop 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f372404ba60 msgr2=0x7f37240ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 --2- 172.21.15.46:0/681782968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f372404ba60 0x7f37240ced40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f372000c4a0 tx=0x7f372000c960 comp rx=0 tx=0).stop 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f372bfff640 1 -- 172.21.15.46:0/681782968 reap_dead start 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 shutdown_connections 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 >> 172.21.15.46:0/681782968 conn(0x7f3724050180 msgr2=0x7f372404a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 shutdown_connections 2024-01-27T13:32:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.567+0000 7f3730e44640 1 -- 172.21.15.46:0/681782968 wait complete. 2024-01-27T13:32:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.569+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b44058430 con 0x7f1b54156f90 2024-01-27T13:32:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.569+0000 7f1b4affd640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7f1b380746b0 0x7f1b38076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.569+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 --> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b38077220 con 0x7f1b380746b0 2024-01-27T13:32:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.570+0000 7f1b59917640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7f1b380746b0 0x7f1b38076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.570+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b440044f0 con 0x7f1b54156f90 2024-01-27T13:32:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.570+0000 7f1b59917640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7f1b380746b0 0x7f1b38076b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.570+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474068200 con 0x7fa46c0d5c30 2024-01-27T13:32:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.570+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474068380 con 0x7fa46c0d5c30 2024-01-27T13:32:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.570+0000 7fa479fac640 1 -- 172.21.15.46:0/3296113193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c0dda80 con 0x7fa46c0d5c30 2024-01-27T13:32:51.564 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T13:32:51.564 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-27T13:32:51.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.571+0000 7fa479fac640 1 -- 172.21.15.46:0/3296113193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c04fe40 con 0x7fa46c0d5c30 2024-01-27T13:32:51.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.571+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474074370 con 0x7fa46c0d5c30 2024-01-27T13:32:51.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.571+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== osd.6 v2:172.21.15.78:6800/2551716118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1b38077220 con 0x7f1b380746b0 2024-01-27T13:32:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.571+0000 7fa479fac640 1 -- 172.21.15.46:0/3296113193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa454001030 con 0x7fa46c0d5c30 2024-01-27T13:32:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.578+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 --> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f672404f8c0 con 0x7f67180747b0 2024-01-27T13:32:51.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.578+0000 7f67137fe640 1 -- 172.21.15.46:0/2675182328 <== osd.2 v2:172.21.15.46:6826/2828306015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f672404f8c0 con 0x7f67180747b0 2024-01-27T13:32:51.571 INFO:teuthology.orchestra.run.smithi046.stdout:60129542158 2024-01-27T13:32:51.571 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-27T13:32:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7f67180747b0 msgr2=0x7f6718076c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7f67180747b0 0x7f6718076c50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f671806af50 msgr2=0x7f671806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f671806af50 0x7f671806d410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6724006870 tx=0x7f6720009040 comp rx=0 tx=0).stop 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67240076c0 msgr2=0x7f6724178980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 --2- 172.21.15.46:0/2675182328 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f67240076c0 0x7f6724178980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f671c00c7f0 tx=0x7f671c00ccb0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f672bfff640 1 -- 172.21.15.46:0/2675182328 reap_dead start 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 shutdown_connections 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 >> 172.21.15.46:0/2675182328 conn(0x7f6724050360 msgr2=0x7f67240d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 shutdown_connections 2024-01-27T13:32:51.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.579+0000 7f67317e5640 1 -- 172.21.15.46:0/2675182328 wait complete. 2024-01-27T13:32:51.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.580+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f274c0128c0 con 0x7f275c071790 2024-01-27T13:32:51.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.580+0000 7f27437fe640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274806af90 0x7f274806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.580+0000 7f275a7fc640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274806af90 0x7f274806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.581+0000 7f275a7fc640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274806af90 0x7f274806d450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2750036000 tx=0x7f275002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.585+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8228040cc0 con 0x7f822c06c9c0 2024-01-27T13:32:51.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.585+0000 7f8221ffb640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f821006af20 0x7f821006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.586+0000 7f8230d64640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f821006af20 0x7f821006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.586+0000 7f8230d64640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f821006af20 0x7f821006d3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f821c007fd0 tx=0x7f821c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.588+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 --> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b540c0ec0 con 0x7f1b380746b0 2024-01-27T13:32:51.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.588+0000 7f1b4affd640 1 -- 172.21.15.46:0/2856776294 <== osd.6 v2:172.21.15.78:6800/2551716118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b50038440 con 0x7f1b380746b0 2024-01-27T13:32:51.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7f1b380746b0 msgr2=0x7f1b38076b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7f1b380746b0 0x7f1b38076b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b3806aed0 msgr2=0x7f1b3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b3806aed0 0x7f1b3806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00a400 tx=0x7f1b4c00d040 comp rx=0 tx=0).stop 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b54156f90 msgr2=0x7f1b541eb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 --2- 172.21.15.46:0/2856776294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b54156f90 0x7f1b541eb340 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400c540 tx=0x7f1b4400ca00 comp rx=0 tx=0).stop 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5a919640 1 -- 172.21.15.46:0/2856776294 reap_dead start 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 shutdown_connections 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 >> 172.21.15.46:0/2856776294 conn(0x7f1b540cbff0 msgr2=0x7f1b5406be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 shutdown_connections 2024-01-27T13:32:51.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f1b5b11a640 1 -- 172.21.15.46:0/2856776294 wait complete. 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8228053e60 con 0x7f822c06c9c0 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f8221ffb640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7f8210074780 0x7f8210076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 --> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f82100772f0 con 0x7f8210074780 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.589+0000 7f8231d66640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7f8210074780 0x7f8210076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.590+0000 7f8231d66640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7f8210074780 0x7f8210076c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.590+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8228077540 con 0x7f822c06c9c0 2024-01-27T13:32:51.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.591+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== osd.0 v2:172.21.15.46:6802/3092334120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f82100772f0 con 0x7f8210074780 2024-01-27T13:32:51.584 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T13:32:51.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-27T13:32:51.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.593+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fec0c00f3c0 con 0x7fec1c06dd50 2024-01-27T13:32:51.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.594+0000 7fec12ffd640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7febfc06aed0 0x7febfc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.594+0000 7fec13fff640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7febfc06aed0 0x7febfc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.595+0000 7fec13fff640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7febfc06aed0 0x7febfc06d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec04036000 tx=0x7fec0403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.598+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f274c059350 con 0x7f275c071790 2024-01-27T13:32:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.598+0000 7f27437fe640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f2748074770 0x7f2748076c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.598+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 --> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27480772e0 con 0x7f2748074770 2024-01-27T13:32:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.598+0000 7f275b7fe640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f2748074770 0x7f2748076c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.599+0000 7f275b7fe640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f2748074770 0x7f2748076c10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.600+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== osd.7 v2:172.21.15.78:6809/3083867566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f27480772e0 con 0x7f2748074770 2024-01-27T13:32:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.602+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec0c058790 con 0x7fec1c06dd50 2024-01-27T13:32:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.602+0000 7fec12ffd640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7febfc0746b0 0x7febfc076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.603+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 --> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febfc077220 con 0x7febfc0746b0 2024-01-27T13:32:51.596 INFO:teuthology.orchestra.run.smithi046.stdout:60129542158 2024-01-27T13:32:51.596 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-27T13:32:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.603+0000 7fec1ad9d640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7febfc0746b0 0x7febfc076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.603+0000 7fec1ad9d640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7febfc0746b0 0x7febfc076b50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.604+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== osd.5 v2:172.21.15.78:6824/4205695749 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7febfc077220 con 0x7febfc0746b0 2024-01-27T13:32:51.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.607+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec0c0092d0 con 0x7fec1c06dd50 2024-01-27T13:32:51.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.614+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 --> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f822c14fc60 con 0x7f8210074780 2024-01-27T13:32:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.615+0000 7f8221ffb640 1 -- 172.21.15.46:0/3808101651 <== osd.0 v2:172.21.15.46:6802/3092334120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8224007e70 con 0x7f8210074780 2024-01-27T13:32:51.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.615+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa474090070 con 0x7fa46c0d5c30 2024-01-27T13:32:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.616+0000 7fa4717fa640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa45806aed0 0x7fa45806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.616+0000 7fa478faa640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa45806aed0 0x7fa45806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.616+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7f8210074780 msgr2=0x7f8210076c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7f8210074780 0x7f8210076c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7fa478faa640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa45806aed0 0x7fa45806d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa468036000 tx=0x7fa468008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f821006af20 msgr2=0x7f821006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f821006af20 0x7f821006d3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f821c007fd0 tx=0x7f821c009040 comp rx=0 tx=0).stop 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c06c9c0 msgr2=0x7f822c148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 --2- 172.21.15.46:0/3808101651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f822c06c9c0 0x7f822c148f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8228033000 tx=0x7f82280046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8231d66640 1 -- 172.21.15.46:0/3808101651 reap_dead start 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 shutdown_connections 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 >> 172.21.15.46:0/3808101651 conn(0x7f822c0c76f0 msgr2=0x7f822c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 shutdown_connections 2024-01-27T13:32:51.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.617+0000 7f8232567640 1 -- 172.21.15.46:0/3808101651 wait complete. 2024-01-27T13:32:51.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.621+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4740d2fe0 con 0x7fa46c0d5c30 2024-01-27T13:32:51.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.621+0000 7fa4717fa640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7fa4580746b0 0x7fa458076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.621+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 --> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa458077220 con 0x7fa4580746b0 2024-01-27T13:32:51.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.621+0000 7fa473fff640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7fa4580746b0 0x7fa458076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.622+0000 7fa473fff640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7fa4580746b0 0x7fa458076b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.628+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== osd.1 v2:172.21.15.46:6810/2794574538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa458077220 con 0x7fa4580746b0 2024-01-27T13:32:51.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.631+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 --> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f273c002d30 con 0x7f2748074770 2024-01-27T13:32:51.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.633+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f274c0125f0 con 0x7f275c071790 2024-01-27T13:32:51.628 INFO:teuthology.orchestra.run.smithi046.stdout:55834574862 2024-01-27T13:32:51.629 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-27T13:32:51.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.636+0000 7f27437fe640 1 -- 172.21.15.46:0/1882159115 <== osd.7 v2:172.21.15.78:6809/3083867566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f273c002d30 con 0x7f2748074770 2024-01-27T13:32:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.635+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 --> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec1c159970 con 0x7febfc0746b0 2024-01-27T13:32:51.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.636+0000 7fec12ffd640 1 -- 172.21.15.46:0/884075465 <== osd.5 v2:172.21.15.78:6824/4205695749 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fec14009bb0 con 0x7febfc0746b0 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.636+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f2748074770 msgr2=0x7f2748076c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.636+0000 7f275bfff640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f2748074770 0x7f2748076c10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274806af90 msgr2=0x7f274806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274806af90 0x7f274806d450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2750036000 tx=0x7f275002e000 comp rx=0 tx=0).stop 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 msgr2=0x7f275c0acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 --2- 172.21.15.46:0/1882159115 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f275c071790 0x7f275c0acb20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f274c00d5f0 tx=0x7f274c00dab0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275b7fe640 1 -- 172.21.15.46:0/1882159115 reap_dead start 2024-01-27T13:32:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7febfc0746b0 msgr2=0x7febfc076b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7febfc0746b0 0x7febfc076b50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 shutdown_connections 2024-01-27T13:32:51.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 >> 172.21.15.46:0/1882159115 conn(0x7f275c06ee40 msgr2=0x7f275c073e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7febfc06aed0 msgr2=0x7febfc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7febfc06aed0 0x7febfc06d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec04036000 tx=0x7fec0403b040 comp rx=0 tx=0).stop 2024-01-27T13:32:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c06dd50 msgr2=0x7fec1c1f2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 --2- 172.21.15.46:0/884075465 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fec1c06dd50 0x7fec1c1f2cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00b4d0 tx=0x7fec0c00b990 comp rx=0 tx=0).stop 2024-01-27T13:32:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1ad9d640 1 -- 172.21.15.46:0/884075465 reap_dead start 2024-01-27T13:32:51.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 shutdown_connections 2024-01-27T13:32:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 shutdown_connections 2024-01-27T13:32:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7f275bfff640 1 -- 172.21.15.46:0/1882159115 wait complete. 2024-01-27T13:32:51.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.637+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 >> 172.21.15.46:0/884075465 conn(0x7fec1c0cbff0 msgr2=0x7fec1c158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.638+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 shutdown_connections 2024-01-27T13:32:51.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.638+0000 7fec1b59e640 1 -- 172.21.15.46:0/884075465 wait complete. 2024-01-27T13:32:51.655 INFO:teuthology.orchestra.run.smithi046.stdout:60129542158 2024-01-27T13:32:51.656 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-27T13:32:51.658 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-01-27T13:32:51.658 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-27T13:32:51.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.679+0000 7fa479fac640 1 -- 172.21.15.46:0/3296113193 --> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa454002d30 con 0x7fa4580746b0 2024-01-27T13:32:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.680+0000 7fa4717fa640 1 -- 172.21.15.46:0/3296113193 <== osd.1 v2:172.21.15.46:6810/2794574538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa454002d30 con 0x7fa4580746b0 2024-01-27T13:32:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.680+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7fa4580746b0 msgr2=0x7fa458076b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.680+0000 7fa45effd640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7fa4580746b0 0x7fa458076b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa45806aed0 msgr2=0x7fa45806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa45effd640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fa45806aed0 0x7fa45806d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa468036000 tx=0x7fa468008030 comp rx=0 tx=0).stop 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 msgr2=0x7fa46c168230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa45effd640 1 --2- 172.21.15.46:0/3296113193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa46c0d5c30 0x7fa46c168230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa4740749c0 tx=0x7fa47406cc70 comp rx=0 tx=0).stop 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa4797ab640 1 -- 172.21.15.46:0/3296113193 reap_dead start 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 shutdown_connections 2024-01-27T13:32:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.681+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 >> 172.21.15.46:0/3296113193 conn(0x7fa46c0505d0 msgr2=0x7fa46c046d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.683+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 shutdown_connections 2024-01-27T13:32:51.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.683+0000 7fa45effd640 1 -- 172.21.15.46:0/3296113193 wait complete. 2024-01-27T13:32:51.696 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T13:32:51.696 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.742+0000 7ff72c968640 1 Processor -- start 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.742+0000 7ff72c968640 1 -- start start 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.744+0000 7ff72c968640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff7200d6ec0 0x7ff720047ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.744+0000 7ff72c968640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff720047530 con 0x7ff720047750 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.744+0000 7ff72c968640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72004d380 con 0x7ff72004f7c0 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.744+0000 7ff72c968640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72004d620 con 0x7ff7200d6ec0 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.745+0000 7ff726d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff72004f7c0 0x7ff720052300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:36764/0 (socket says 172.21.15.46:36764) 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.745+0000 7ff726d9d640 1 -- 172.21.15.46:0/4039208445 learned_addr learned my addr 172.21.15.46:0/4039208445 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.745+0000 7ff72659c640 1 --2- 172.21.15.46:0/4039208445 >> v2:172.21.15.78:3300/0 conn(0x7ff7200d6ec0 0x7ff720047ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.755+0000 7f1d301e5640 1 Processor -- start 2024-01-27T13:32:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.755+0000 7f1d301e5640 1 -- start start 2024-01-27T13:32:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.756+0000 7f1d301e5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1d28157f30 0x7f1d2806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.756+0000 7f1d301e5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d2815db70 0x7f1d2815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.756+0000 7f1d301e5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280c2d40 con 0x7f1d280b1d20 2024-01-27T13:32:51.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.756+0000 7f1d301e5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2815e520 con 0x7f1d28157f30 2024-01-27T13:32:51.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.756+0000 7f1d301e5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d28158310 con 0x7f1d2815db70 2024-01-27T13:32:51.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.757+0000 7ff72659c640 1 -- 172.21.15.46:0/4039208445 >> v1:172.21.15.78:6789/0 conn(0x7ff72004f7c0 legacy=0x7ff720052300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.757+0000 7ff72659c640 1 -- 172.21.15.46:0/4039208445 >> v1:172.21.15.46:6789/0 conn(0x7ff720047750 legacy=0x7ff7200dd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.757+0000 7ff72659c640 1 -- 172.21.15.46:0/4039208445 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7200d72a0 con 0x7ff7200d6ec0 2024-01-27T13:32:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.759+0000 7f1d2e782640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d2815db70 0x7f1d2815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.760+0000 7f1d2d780640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1d280b1d20 0x7f1d2806a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40406/0 (socket says 172.21.15.46:40406) 2024-01-27T13:32:51.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.760+0000 7f1d2d780640 1 -- 172.21.15.46:0/888159466 learned_addr learned my addr 172.21.15.46:0/888159466 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.762+0000 7ff72659c640 1 --2- 172.21.15.46:0/4039208445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff720047ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0097a0 tx=0x7ff71c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8357e6f8729bfdf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.765+0000 7f1d2df81640 1 --2- 172.21.15.46:0/888159466 >> v2:172.21.15.46:3300/0 conn(0x7f1d28157f30 0x7f1d2806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.768+0000 7f1d2e782640 1 -- 172.21.15.46:0/888159466 >> v2:172.21.15.46:3300/0 conn(0x7f1d28157f30 msgr2=0x7f1d2806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.768+0000 7f1d2e782640 1 --2- 172.21.15.46:0/888159466 >> v2:172.21.15.46:3300/0 conn(0x7f1d28157f30 0x7f1d2806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.768+0000 7f1d2e782640 1 -- 172.21.15.46:0/888159466 >> v1:172.21.15.46:6789/0 conn(0x7f1d280b1d20 legacy=0x7f1d2806a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.768+0000 7f1d2e782640 1 -- 172.21.15.46:0/888159466 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2806ebf0 con 0x7f1d2815db70 2024-01-27T13:32:51.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.769+0000 7ff72559a640 1 -- 172.21.15.46:0/4039208445 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c02f840 con 0x7ff7200d6ec0 2024-01-27T13:32:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.769+0000 7ff72559a640 1 -- 172.21.15.46:0/4039208445 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c02f9a0 con 0x7ff7200d6ec0 2024-01-27T13:32:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.769+0000 7ff72559a640 1 -- 172.21.15.46:0/4039208445 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c02fd70 con 0x7ff7200d6ec0 2024-01-27T13:32:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.770+0000 7f1d2e782640 1 --2- 172.21.15.46:0/888159466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d2815db70 0x7f1d2815dfe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d2806b270 tx=0x7f1d2002bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b9a8165aae20e75 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.770+0000 7ff72c968640 1 -- 172.21.15.46:0/4039208445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 msgr2=0x7ff720047ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.771+0000 7ff72c968640 1 --2- 172.21.15.46:0/4039208445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff720047ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0097a0 tx=0x7ff71c02ba20 comp rx=0 tx=0).stop 2024-01-27T13:32:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.771+0000 7ff72c968640 1 -- 172.21.15.46:0/4039208445 shutdown_connections 2024-01-27T13:32:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.771+0000 7ff72c968640 1 --2- 172.21.15.46:0/4039208445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff720047ca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.771+0000 7ff72c968640 1 -- 172.21.15.46:0/4039208445 >> 172.21.15.46:0/4039208445 conn(0x7ff72000e080 msgr2=0x7ff72000e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.771+0000 7ff72c968640 1 -- 172.21.15.46:0/4039208445 shutdown_connections 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.771+0000 7ff72c968640 1 -- 172.21.15.46:0/4039208445 wait complete. 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.773+0000 7ff72c968640 1 Processor -- start 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.773+0000 7ff72c968640 1 -- start start 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.774+0000 7ff72c968640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff720047750 0x7ff72004c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.774+0000 7ff72c968640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72004f7c0 0x7ff7200379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.774+0000 7ff72c968640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff7201960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff72c968640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72004c700 con 0x7ff72004f7c0 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff72c968640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200dde20 con 0x7ff7200d6ec0 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff72c968640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200de100 con 0x7ff720047750 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff72659c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff720047750 0x7ff72004c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff726d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff7201960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff72659c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff720047750 0x7ff72004c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43792/0 (socket says 172.21.15.46:43792) 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.775+0000 7ff72659c640 1 -- 172.21.15.46:0/446433716 learned_addr learned my addr 172.21.15.46:0/446433716 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.776+0000 7f1d2cf7f640 1 -- 172.21.15.46:0/888159466 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2002cd40 con 0x7f1d2815db70 2024-01-27T13:32:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.776+0000 7f1d2cf7f640 1 -- 172.21.15.46:0/888159466 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d20034440 con 0x7f1d2815db70 2024-01-27T13:32:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.776+0000 7f1d2cf7f640 1 -- 172.21.15.46:0/888159466 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2002cea0 con 0x7f1d2815db70 2024-01-27T13:32:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 -- 172.21.15.46:0/888159466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d2815db70 msgr2=0x7f1d2815dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 --2- 172.21.15.46:0/888159466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d2815db70 0x7f1d2815dfe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d2806b270 tx=0x7f1d2002bf90 comp rx=0 tx=0).stop 2024-01-27T13:32:51.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f276756e640 1 Processor -- start 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 -- 172.21.15.46:0/888159466 shutdown_connections 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 --2- 172.21.15.46:0/888159466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d2815db70 0x7f1d2815dfe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 --2- 172.21.15.46:0/888159466 >> v2:172.21.15.46:3300/0 conn(0x7f1d28157f30 0x7f1d2806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 -- 172.21.15.46:0/888159466 >> 172.21.15.46:0/888159466 conn(0x7f1d280c8a10 msgr2=0x7f1d280c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 -- 172.21.15.46:0/888159466 shutdown_connections 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.777+0000 7f1d301e5640 1 -- 172.21.15.46:0/888159466 wait complete. 2024-01-27T13:32:51.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.778+0000 7f276756e640 1 -- start start 2024-01-27T13:32:51.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f1d301e5640 1 Processor -- start 2024-01-27T13:32:51.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f276756e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2760158090 0x7f2760161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f276756e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f276006ce50 0x7f2760071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f276756e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27601616d0 con 0x7f27600715d0 2024-01-27T13:32:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f276756e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27601620a0 con 0x7f276006ce50 2024-01-27T13:32:51.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f276756e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27600c1110 con 0x7f2760158090 2024-01-27T13:32:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7ff726d9d640 1 -- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff720047750 msgr2=0x7ff72004c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7ff726d9d640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff720047750 0x7ff72004c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7ff726d9d640 1 -- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72004f7c0 msgr2=0x7ff7200379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7ff726d9d640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72004f7c0 0x7ff7200379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7ff726d9d640 1 -- 172.21.15.46:0/446433716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009400 con 0x7ff7200d6ec0 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.779+0000 7f1d301e5640 1 -- start start 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7f1d301e5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 0x7f1d28153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7f1d301e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d28157f30 0x7f1d28154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7f1d301e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2815db70 0x7f1d28140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7f1d301e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2813fbe0 con 0x7f1d2815db70 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7f1d301e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280c50d0 con 0x7f1d28157f30 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.780+0000 7f1d301e5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d280c32f0 con 0x7f1d280b1d20 2024-01-27T13:32:51.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.781+0000 7f1d2df81640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 0x7f1d28153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.783+0000 7ff726d9d640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff7201960d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff72804fcc0 tx=0x7ff72806cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.783+0000 7f276530a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2760158090 0x7f2760161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.783+0000 7f1d2df81640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 0x7f1d28153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43794/0 (socket says 172.21.15.46:43794) 2024-01-27T13:32:51.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.783+0000 7f1d2df81640 1 -- 172.21.15.46:0/3676262950 learned_addr learned my addr 172.21.15.46:0/3676262950 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.784+0000 7f276530a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2760158090 0x7f2760161b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56438/0 (socket says 172.21.15.46:56438) 2024-01-27T13:32:51.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.784+0000 7f276530a640 1 -- 172.21.15.46:0/664582174 learned_addr learned my addr 172.21.15.46:0/664582174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7f1d2d780640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d28157f30 0x7f1d28154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7f1d2df81640 1 -- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d28157f30 msgr2=0x7f1d28154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7f1d2df81640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d28157f30 0x7f1d28154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7f1d2df81640 1 -- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2815db70 msgr2=0x7f1d28140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7f1d2df81640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2815db70 0x7f1d28140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7f1d2df81640 1 -- 172.21.15.46:0/3676262950 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009a70 con 0x7f1d280b1d20 2024-01-27T13:32:51.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7fd6b0e3d640 1 Processor -- start 2024-01-27T13:32:51.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.787+0000 7fd6b0e3d640 1 -- start start 2024-01-27T13:32:51.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.789+0000 7fd6b0e3d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 0x7fd6ac1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.789+0000 7fd6b0e3d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd6ac0c99d0 0x7fd6ac0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.789+0000 7fd6b0e3d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd6ac0c8010 0x7fd6ac06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.789+0000 7fd6b0e3d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c67b0 con 0x7fd6ac0c99d0 2024-01-27T13:32:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.789+0000 7fd6b0e3d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c7620 con 0x7fd6ac0c8010 2024-01-27T13:32:51.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.789+0000 7fd6b0e3d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c8440 con 0x7fd6ac153b80 2024-01-27T13:32:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.790+0000 7fd6aa59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 0x7fd6ac1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.790+0000 7f1d2df81640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 0x7f1d28153390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800e9b0 tx=0x7f1d1800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.790+0000 7f276530a640 1 -- 172.21.15.46:0/664582174 >> v2:172.21.15.46:3300/0 conn(0x7f276006ce50 msgr2=0x7f2760071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.790+0000 7f276530a640 1 --2- 172.21.15.46:0/664582174 >> v2:172.21.15.46:3300/0 conn(0x7f276006ce50 0x7f2760071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.790+0000 7f276530a640 1 -- 172.21.15.46:0/664582174 >> v1:172.21.15.78:6789/0 conn(0x7f27600715d0 legacy=0x7f276006e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.790+0000 7f276530a640 1 -- 172.21.15.46:0/664582174 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600c13f0 con 0x7f2760158090 2024-01-27T13:32:51.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.791+0000 7fd6aa59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 0x7fd6ac1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43802/0 (socket says 172.21.15.46:43802) 2024-01-27T13:32:51.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.791+0000 7fd6aa59c640 1 -- 172.21.15.46:0/3846454956 learned_addr learned my addr 172.21.15.46:0/3846454956 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.793+0000 7fd6aad9d640 1 --2- 172.21.15.46:0/3846454956 >> v2:172.21.15.78:3300/0 conn(0x7fd6ac0c8010 0x7fd6ac06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.794+0000 7fd6aa59c640 1 -- 172.21.15.46:0/3846454956 >> v2:172.21.15.78:3300/0 conn(0x7fd6ac0c8010 msgr2=0x7fd6ac06ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.794+0000 7fd6aa59c640 1 --2- 172.21.15.46:0/3846454956 >> v2:172.21.15.78:3300/0 conn(0x7fd6ac0c8010 0x7fd6ac06ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.794+0000 7fd6aa59c640 1 -- 172.21.15.46:0/3846454956 >> v2:172.21.15.46:3300/0 conn(0x7fd6ac0c99d0 msgr2=0x7fd6ac0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.794+0000 7fd6aa59c640 1 --2- 172.21.15.46:0/3846454956 >> v2:172.21.15.46:3300/0 conn(0x7fd6ac0c99d0 0x7fd6ac0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.794+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72806c310 con 0x7ff7200d6ec0 2024-01-27T13:32:51.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.795+0000 7fd6aa59c640 1 -- 172.21.15.46:0/3846454956 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0ca180 con 0x7fd6ac153b80 2024-01-27T13:32:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.795+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7200de3e0 con 0x7ff7200d6ec0 2024-01-27T13:32:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.795+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff720037f30 con 0x7ff7200d6ec0 2024-01-27T13:32:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.795+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72808e070 con 0x7ff7200d6ec0 2024-01-27T13:32:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.795+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72806a710 con 0x7ff7200d6ec0 2024-01-27T13:32:51.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.796+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c005290 con 0x7ff7200d6ec0 2024-01-27T13:32:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.797+0000 7f276530a640 1 --2- 172.21.15.46:0/664582174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2760158090 0x7f2760161b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2750009870 tx=0x7f275002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c8c55e6d087d1c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.797+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18009670 con 0x7f1d280b1d20 2024-01-27T13:32:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.798+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1800c9a0 con 0x7f1d280b1d20 2024-01-27T13:32:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.798+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d280c3590 con 0x7f1d280b1d20 2024-01-27T13:32:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.798+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800cd50 con 0x7f1d280b1d20 2024-01-27T13:32:51.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.798+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d280c3b50 con 0x7f1d280b1d20 2024-01-27T13:32:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.799+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d28074410 con 0x7f1d280b1d20 2024-01-27T13:32:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.799+0000 7fd6aa59c640 1 --2- 172.21.15.46:0/3846454956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 0x7fd6ac1598e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac06b6a0 tx=0x7fd69c02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0d6502208f7f688 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.822+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1d18013470 con 0x7f1d280b1d20 2024-01-27T13:32:51.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.822+0000 7f41d0458640 1 Processor -- start 2024-01-27T13:32:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.822+0000 7f41d0458640 1 -- start start 2024-01-27T13:32:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.822+0000 7f1d1e7fc640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1d0c06aed0 0x7f1d0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.822+0000 7f1d2d780640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1d0c06aed0 0x7f1d0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.823+0000 7f1d2d780640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1d0c06aed0 0x7f1d0c06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d2815b9c0 tx=0x7f1d24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.823+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d180592a0 con 0x7f1d280b1d20 2024-01-27T13:32:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.823+0000 7f41d0458640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f41c8153a70 0x7f41c80c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.823+0000 7f41d0458640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41c806c910 0x7f41c815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.824+0000 7f41d0458640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c80c3f90 con 0x7f41c806c4f0 2024-01-27T13:32:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.824+0000 7f41d0458640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c806cd20 con 0x7f41c806c910 2024-01-27T13:32:51.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.824+0000 7f41d0458640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c806c060 con 0x7f41c8153a70 2024-01-27T13:32:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.829+0000 7f0d101be640 1 Processor -- start 2024-01-27T13:32:51.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.829+0000 7f0d101be640 1 -- start start 2024-01-27T13:32:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.830+0000 7f0d101be640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0d081538a0 0x7f0d0815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.831+0000 7f0d101be640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d08159770 0x7f0d081640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.831+0000 7f0d101be640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d08153c80 con 0x7f0d0815da10 2024-01-27T13:32:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.831+0000 7f0d101be640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0815cd60 con 0x7f0d081538a0 2024-01-27T13:32:51.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.831+0000 7f0d101be640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0806e3c0 con 0x7f0d08159770 2024-01-27T13:32:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.837+0000 7fca1fb3e640 1 Processor -- start 2024-01-27T13:32:51.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.838+0000 7fca1fb3e640 1 -- start start 2024-01-27T13:32:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.838+0000 7fca1fb3e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 0x7fca180c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.838+0000 7fca1fb3e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca180c23f0 0x7fca1806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.838+0000 7fca1fb3e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca18070190 con 0x7fca180c6910 2024-01-27T13:32:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.838+0000 7fca1fb3e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180c3180 con 0x7fca180c23f0 2024-01-27T13:32:51.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.838+0000 7fca1fb3e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180c7230 con 0x7fca18070620 2024-01-27T13:32:51.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.868+0000 7f41ce9f5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41c806c910 0x7f41c815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.868+0000 7f41ce9f5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f41c806c910 0x7f41c815d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49740/0 (socket says 172.21.15.46:49740) 2024-01-27T13:32:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.868+0000 7f41ce9f5640 1 -- 172.21.15.46:0/3009418881 learned_addr learned my addr 172.21.15.46:0/3009418881 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.869+0000 7f0d0df5a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0d081538a0 0x7f0d0815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.871+0000 7f41ce9f5640 1 -- 172.21.15.46:0/3009418881 >> v2:172.21.15.78:3300/0 conn(0x7f41c8153a70 msgr2=0x7f41c80c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.871+0000 7f41ce9f5640 1 --2- 172.21.15.46:0/3009418881 >> v2:172.21.15.78:3300/0 conn(0x7f41c8153a70 0x7f41c80c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.871+0000 7f41ce9f5640 1 -- 172.21.15.46:0/3009418881 >> v1:172.21.15.46:6789/0 conn(0x7f41c806c4f0 legacy=0x7f41c815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.871+0000 7f41ce9f5640 1 -- 172.21.15.46:0/3009418881 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c80670d0 con 0x7f41c806c910 2024-01-27T13:32:51.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.873+0000 7f0d0df5a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0d081538a0 0x7f0d0815d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49742/0 (socket says 172.21.15.46:49742) 2024-01-27T13:32:51.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.873+0000 7f0d0df5a640 1 -- 172.21.15.46:0/4283089283 learned_addr learned my addr 172.21.15.46:0/4283089283 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.874+0000 7f41ce9f5640 1 --2- 172.21.15.46:0/3009418881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c815d530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41c806d0f0 tx=0x7f41c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bab661ef4ce2277 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.878+0000 7f0d0df5a640 1 -- 172.21.15.46:0/4283089283 >> v2:172.21.15.78:3300/0 conn(0x7f0d08159770 msgr2=0x7f0d081640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.878+0000 7f0d0df5a640 1 --2- 172.21.15.46:0/4283089283 >> v2:172.21.15.78:3300/0 conn(0x7f0d08159770 0x7f0d081640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.878+0000 7f0d0df5a640 1 -- 172.21.15.46:0/4283089283 >> v1:172.21.15.78:6789/0 conn(0x7f0d0815da10 legacy=0x7f0d080c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.878+0000 7f0d0df5a640 1 -- 172.21.15.46:0/4283089283 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080c97c0 con 0x7f0d081538a0 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.879+0000 7f6dd8c90640 1 Processor -- start 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.879+0000 7f6dd8c90640 1 -- start start 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.880+0000 7f6dd8c90640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6dd40c7470 0x7f6dd4159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.880+0000 7f6dd8c90640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6dd40c7920 0x7f6dd4159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.880+0000 7f6dd8c90640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd415a8c0 con 0x7f6dd40c7090 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.880+0000 7f6dd8c90640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd40700b0 con 0x7f6dd40c7920 2024-01-27T13:32:51.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.880+0000 7f6dd8c90640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd415a5e0 con 0x7f6dd40c7470 2024-01-27T13:32:51.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.883+0000 7f0d0df5a640 1 --2- 172.21.15.46:0/4283089283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d0815d4d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d080b1bc0 tx=0x7f0d0402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d4f5ee6168d8db server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.886+0000 7f6dd2d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6dd40c7920 0x7f6dd4159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.887+0000 7fca1d8da640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fca180c6910 0x7fca1815cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40418/0 (socket says 172.21.15.46:40418) 2024-01-27T13:32:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.887+0000 7fca1d8da640 1 -- 172.21.15.46:0/170532720 learned_addr learned my addr 172.21.15.46:0/170532720 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:51.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.887+0000 7f6dd2d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6dd40c7920 0x7f6dd4159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49756/0 (socket says 172.21.15.46:49756) 2024-01-27T13:32:51.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.887+0000 7f6dd2d9d640 1 -- 172.21.15.46:0/2032818763 learned_addr learned my addr 172.21.15.46:0/2032818763 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.892+0000 7f0d0cf58640 1 -- 172.21.15.46:0/4283089283 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d040317e0 con 0x7f0d081538a0 2024-01-27T13:32:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.892+0000 7f0d0cf58640 1 -- 172.21.15.46:0/4283089283 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d04031940 con 0x7f0d081538a0 2024-01-27T13:32:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.892+0000 7f0d0cf58640 1 -- 172.21.15.46:0/4283089283 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04031cd0 con 0x7f0d081538a0 2024-01-27T13:32:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 -- 172.21.15.46:0/4283089283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 msgr2=0x7f0d0815d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 --2- 172.21.15.46:0/4283089283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d0815d4d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d080b1bc0 tx=0x7f0d0402b880 comp rx=0 tx=0).stop 2024-01-27T13:32:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 -- 172.21.15.46:0/4283089283 shutdown_connections 2024-01-27T13:32:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 --2- 172.21.15.46:0/4283089283 >> v2:172.21.15.78:3300/0 conn(0x7f0d08159770 0x7f0d081640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 --2- 172.21.15.46:0/4283089283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d0815d4d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 -- 172.21.15.46:0/4283089283 >> 172.21.15.46:0/4283089283 conn(0x7f0d0806b820 msgr2=0x7f0d0806bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 -- 172.21.15.46:0/4283089283 shutdown_connections 2024-01-27T13:32:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.893+0000 7f0d101be640 1 -- 172.21.15.46:0/4283089283 wait complete. 2024-01-27T13:32:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.894+0000 7f6dd2d9d640 1 -- 172.21.15.46:0/2032818763 >> v2:172.21.15.78:3300/0 conn(0x7f6dd40c7470 msgr2=0x7f6dd4159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.894+0000 7f6dd2d9d640 1 --2- 172.21.15.46:0/2032818763 >> v2:172.21.15.78:3300/0 conn(0x7f6dd40c7470 0x7f6dd4159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.894+0000 7f6dd2d9d640 1 -- 172.21.15.46:0/2032818763 >> v1:172.21.15.78:6789/0 conn(0x7f6dd40c7090 legacy=0x7f6dd406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.894+0000 7f6dd2d9d640 1 -- 172.21.15.46:0/2032818763 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40c0fd0 con 0x7f6dd40c7920 2024-01-27T13:32:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.894+0000 7f0d101be640 1 Processor -- start 2024-01-27T13:32:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.894+0000 7f0d101be640 1 -- start start 2024-01-27T13:32:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f0d101be640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d081f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f0d101be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d08159770 0x7f0d08148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f0d101be640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d0815da10 0x7f0d08152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f0d101be640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080ca520 con 0x7f0d081538a0 2024-01-27T13:32:51.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f0d101be640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08145c70 con 0x7f0d08159770 2024-01-27T13:32:51.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f0d101be640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081f3900 con 0x7f0d0815da10 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f41cd1f2640 1 -- 172.21.15.46:0/3009418881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c002c9f0 con 0x7f41c806c910 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f41cd1f2640 1 -- 172.21.15.46:0/3009418881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c002cb50 con 0x7f41c806c910 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.895+0000 7f41cd1f2640 1 -- 172.21.15.46:0/3009418881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c00343f0 con 0x7f41c806c910 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 -- 172.21.15.46:0/3009418881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 msgr2=0x7f41c815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 --2- 172.21.15.46:0/3009418881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c815d530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f41c806d0f0 tx=0x7f41c002be50 comp rx=0 tx=0).stop 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 -- 172.21.15.46:0/3009418881 shutdown_connections 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 --2- 172.21.15.46:0/3009418881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c815d530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 --2- 172.21.15.46:0/3009418881 >> v2:172.21.15.78:3300/0 conn(0x7f41c8153a70 0x7f41c80c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 -- 172.21.15.46:0/3009418881 >> 172.21.15.46:0/3009418881 conn(0x7f41c808b600 msgr2=0x7f41c80663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 -- 172.21.15.46:0/3009418881 shutdown_connections 2024-01-27T13:32:51.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.896+0000 7f41d0458640 1 -- 172.21.15.46:0/3009418881 wait complete. 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.897+0000 7f41d0458640 1 Processor -- start 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.897+0000 7f41d0458640 1 -- start start 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.898+0000 7f41d0458640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c806c4f0 0x7f41c815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.898+0000 7f41d0458640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.898+0000 7f41d0458640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41c8153a70 0x7f41c814b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.898+0000 7f41d0458640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c815af20 con 0x7f41c806c910 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.898+0000 7f41d0458640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c815c710 con 0x7f41c806c4f0 2024-01-27T13:32:51.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.898+0000 7f41d0458640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c815bd40 con 0x7f41c8153a70 2024-01-27T13:32:51.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.899+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156146494 0 0) 0x7fca18070190 con 0x7fca180c6910 2024-01-27T13:32:51.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.899+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca04003520 con 0x7fca180c6910 2024-01-27T13:32:51.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.901+0000 7f6dd2d9d640 1 --2- 172.21.15.46:0/2032818763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 0x7f6dd4159f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40c97e0 tx=0x7f6dcc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e075ef1d3b76adc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7f0d0df5a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d081f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2769046281 0 0) 0x7fca04003520 con 0x7fca180c6910 2024-01-27T13:32:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 msgr2=0x7fca180c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 0x7fca180c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 >> v2:172.21.15.78:3300/0 conn(0x7fca180c23f0 msgr2=0x7fca1806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 --2- 172.21.15.46:0/170532720 >> v2:172.21.15.78:3300/0 conn(0x7fca180c23f0 0x7fca1806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180c2bc0 con 0x7fca180c6910 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2887288732 0 0) 0x7fca140019f0 con 0x7fca180c6910 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 >> v1:172.21.15.46:6789/0 conn(0x7fca180c6910 legacy=0x7fca1815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca04003970 0x7fca04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca040047c0 0x7fca04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 0x7fca0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180c3180 con 0x7fca04003970 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180c7230 con 0x7fca040047c0 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.907+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca040055d0 con 0x7fca18070620 2024-01-27T13:32:51.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.908+0000 7f0d0df5a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d081f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49766/0 (socket says 172.21.15.46:49766) 2024-01-27T13:32:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.908+0000 7f0d0df5a640 1 -- 172.21.15.46:0/2919826803 learned_addr learned my addr 172.21.15.46:0/2919826803 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.909+0000 7f6dd1d9b640 1 -- 172.21.15.46:0/2032818763 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc02cb20 con 0x7f6dd40c7920 2024-01-27T13:32:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.909+0000 7f6dd1d9b640 1 -- 172.21.15.46:0/2032818763 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc02cc80 con 0x7f6dd40c7920 2024-01-27T13:32:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.909+0000 7f6dd1d9b640 1 -- 172.21.15.46:0/2032818763 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0343f0 con 0x7f6dd40c7920 2024-01-27T13:32:51.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.909+0000 7f41cd9f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 -- 172.21.15.46:0/2032818763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 msgr2=0x7f6dd4159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/2032818763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 0x7f6dd4159f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40c97e0 tx=0x7f6dcc02bf80 comp rx=0 tx=0).stop 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 -- 172.21.15.46:0/2032818763 shutdown_connections 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/2032818763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 0x7f6dd4159f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/2032818763 >> v2:172.21.15.78:3300/0 conn(0x7f6dd40c7470 0x7f6dd4159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 -- 172.21.15.46:0/2032818763 >> 172.21.15.46:0/2032818763 conn(0x7f6dd40c8a10 msgr2=0x7f6dd40c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 -- 172.21.15.46:0/2032818763 shutdown_connections 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.910+0000 7f6dd8c90640 1 -- 172.21.15.46:0/2032818763 wait complete. 2024-01-27T13:32:51.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 Processor -- start 2024-01-27T13:32:51.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 -- start start 2024-01-27T13:32:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 0x7f6dd413c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40c7470 0x7f6dd406a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 0x7f6dd41f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:51.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd413aa50 con 0x7f6dd40c7920 2024-01-27T13:32:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd41579d0 con 0x7f6dd40c7090 2024-01-27T13:32:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.912+0000 7f6dd8c90640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4159a90 con 0x7f6dd40c7470 2024-01-27T13:32:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.914+0000 7f0d0df5a640 1 -- 172.21.15.46:0/2919826803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d0815da10 msgr2=0x7f0d08152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.914+0000 7f0d0df5a640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d0815da10 0x7f0d08152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.914+0000 7f0d0df5a640 1 -- 172.21.15.46:0/2919826803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d08159770 msgr2=0x7f0d08148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.914+0000 7f0d0df5a640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d08159770 0x7f0d08148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.914+0000 7f0d0df5a640 1 -- 172.21.15.46:0/2919826803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040094d0 con 0x7f0d081538a0 2024-01-27T13:32:51.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.915+0000 7f41cd9f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49776/0 (socket says 172.21.15.46:49776) 2024-01-27T13:32:51.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.915+0000 7f41cd9f3640 1 -- 172.21.15.46:0/4098653158 learned_addr learned my addr 172.21.15.46:0/4098653158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:51.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.920+0000 7f41cd9f3640 1 -- 172.21.15.46:0/4098653158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41c8153a70 msgr2=0x7f41c814b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.920+0000 7f41cd9f3640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41c8153a70 0x7f41c814b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.920+0000 7f41cd9f3640 1 -- 172.21.15.46:0/4098653158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c806c4f0 msgr2=0x7f41c815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.920+0000 7f41cd9f3640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c806c4f0 0x7f41c815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:51.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.920+0000 7f41cd9f3640 1 -- 172.21.15.46:0/4098653158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0009b30 con 0x7f41c806c910 2024-01-27T13:32:51.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.930+0000 7f0d0df5a640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d081f33c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d04000c00 tx=0x7f0d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.938+0000 7f41cd9f3640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c814a8d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b410 tx=0x7f41b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.940+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04032880 con 0x7f0d081538a0 2024-01-27T13:32:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.940+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d040329e0 con 0x7f0d081538a0 2024-01-27T13:32:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.940+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d080c9ca0 con 0x7f0d081538a0 2024-01-27T13:32:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.940+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d04032d90 con 0x7f0d081538a0 2024-01-27T13:32:51.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.940+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d080ca240 con 0x7f0d081538a0 2024-01-27T13:32:51.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:51.941+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d08074410 con 0x7f0d081538a0 2024-01-27T13:32:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.052+0000 7f2757fff640 1 -- 172.21.15.46:0/664582174 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275002f840 con 0x7f2760158090 2024-01-27T13:32:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.052+0000 7f2757fff640 1 -- 172.21.15.46:0/664582174 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275002f9a0 con 0x7f2760158090 2024-01-27T13:32:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.052+0000 7f2757fff640 1 -- 172.21.15.46:0/664582174 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275002fd30 con 0x7f2760158090 2024-01-27T13:32:52.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff72806a890 con 0x7ff7200d6ec0 2024-01-27T13:32:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 -- 172.21.15.46:0/664582174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2760158090 msgr2=0x7f2760161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 --2- 172.21.15.46:0/664582174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2760158090 0x7f2760161b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2750009870 tx=0x7f275002ba20 comp rx=0 tx=0).stop 2024-01-27T13:32:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 -- 172.21.15.46:0/664582174 shutdown_connections 2024-01-27T13:32:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 --2- 172.21.15.46:0/664582174 >> v2:172.21.15.46:3300/0 conn(0x7f276006ce50 0x7f2760071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 --2- 172.21.15.46:0/664582174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2760158090 0x7f2760161b60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 -- 172.21.15.46:0/664582174 >> 172.21.15.46:0/664582174 conn(0x7f27600cae90 msgr2=0x7f27600cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7ff716ffd640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff70806af50 0x7ff70806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 -- 172.21.15.46:0/664582174 shutdown_connections 2024-01-27T13:32:52.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.053+0000 7f276756e640 1 -- 172.21.15.46:0/664582174 wait complete. 2024-01-27T13:32:52.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.054+0000 7ff72659c640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff70806af50 0x7ff70806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.054+0000 7ff72659c640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff70806af50 0x7ff70806d410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02ba60 tx=0x7ff71c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 Processor -- start 2024-01-27T13:32:52.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 -- start start 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f276006ce50 0x7f276015cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27600715d0 0x7f2760160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 0x7f27601470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276014d350 con 0x7f27600715d0 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276015c2c0 con 0x7f276006ce50 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.055+0000 7f276756e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27601f49f0 con 0x7f2760158090 2024-01-27T13:32:52.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.056+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff7280d2e90 con 0x7ff7200d6ec0 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.057+0000 7fd6a959a640 1 -- 172.21.15.46:0/3846454956 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0317e0 con 0x7fd6ac153b80 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.057+0000 7fd6a959a640 1 -- 172.21.15.46:0/3846454956 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c031940 con 0x7fd6ac153b80 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.057+0000 7fd6a959a640 1 -- 172.21.15.46:0/3846454956 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c031cd0 con 0x7fd6ac153b80 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3846454956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 msgr2=0x7fd6ac1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3846454956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 0x7fd6ac1598e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac06b6a0 tx=0x7fd69c02b880 comp rx=0 tx=0).stop 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3846454956 shutdown_connections 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3846454956 >> v2:172.21.15.46:3300/0 conn(0x7fd6ac0c99d0 0x7fd6ac0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3846454956 >> v2:172.21.15.78:3300/0 conn(0x7fd6ac0c8010 0x7fd6ac06ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3846454956 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac153b80 0x7fd6ac1598e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3846454956 >> 172.21.15.46:0/3846454956 conn(0x7fd6ac0cf230 msgr2=0x7fd6ac0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3846454956 shutdown_connections 2024-01-27T13:32:52.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.058+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3846454956 wait complete. 2024-01-27T13:32:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.059+0000 7fd6b0e3d640 1 Processor -- start 2024-01-27T13:32:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 -- start start 2024-01-27T13:32:52.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6ac0c8010 0x7fd6ac0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 0x7fd6ac159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6ac153b80 0x7fd6ac0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1ef3a0 con 0x7fd6ac0c8010 2024-01-27T13:32:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1f2770 con 0x7fd6ac153b80 2024-01-27T13:32:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.060+0000 7fd6b0e3d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac1f2a10 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.074+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff7280cead0 con 0x7ff7200d6ec0 2024-01-27T13:32:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.075+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1d18054ee0 con 0x7f1d280b1d20 2024-01-27T13:32:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.087+0000 7f2765b0b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 0x7f27601470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.088+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 0x7f6dd413c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.089+0000 7f2765b0b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 0x7f27601470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43860/0 (socket says 172.21.15.46:43860) 2024-01-27T13:32:52.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.089+0000 7f2765b0b640 1 -- 172.21.15.46:0/904323371 learned_addr learned my addr 172.21.15.46:0/904323371 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:52.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.089+0000 7f6dd259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 0x7f6dd413c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56526/0 (socket says 172.21.15.46:56526) 2024-01-27T13:32:52.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.089+0000 7f6dd259c640 1 -- 172.21.15.46:0/148316705 learned_addr learned my addr 172.21.15.46:0/148316705 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:52.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.090+0000 7f6dcbfff640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40c7470 0x7f6dd406a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.090+0000 7fca1e0db640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 0x7fca0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.091+0000 7fca1d0d9640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca040047c0 0x7fca04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.094+0000 7f2765b0b640 1 -- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f276006ce50 msgr2=0x7f276015cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.094+0000 7f2765b0b640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f276006ce50 0x7f276015cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.094+0000 7f2765b0b640 1 -- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27600715d0 msgr2=0x7f2760160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.094+0000 7f2765b0b640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27600715d0 0x7f2760160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.094+0000 7f2765b0b640 1 -- 172.21.15.46:0/904323371 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500094d0 con 0x7f2760158090 2024-01-27T13:32:52.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.097+0000 7f6dd259c640 1 -- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40c7470 msgr2=0x7f6dd406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.097+0000 7f6dd259c640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40c7470 0x7f6dd406a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.097+0000 7f6dd259c640 1 -- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 msgr2=0x7f6dd41f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.097+0000 7f6dd259c640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 0x7f6dd41f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.097+0000 7f6dd259c640 1 -- 172.21.15.46:0/148316705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009b30 con 0x7f6dd40c7090 2024-01-27T13:32:52.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7fca1e0db640 1 -- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca040047c0 msgr2=0x7fca04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:52.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7fca1e0db640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca040047c0 0x7fca04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7fca1e0db640 1 -- 172.21.15.46:0/170532720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca04003970 msgr2=0x7fca04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:52.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7fca1e0db640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca04003970 0x7fca04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7fca1e0db640 1 -- 172.21.15.46:0/170532720 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca04003520 con 0x7fca18070620 2024-01-27T13:32:52.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7f2765b0b640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 0x7f27601470d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f275800c730 tx=0x7f275800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.102+0000 7f6dd259c640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 0x7f6dd413c6c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c410 tx=0x7f6dc400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.105+0000 7fca1e0db640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 0x7fca0400b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca10009860 tx=0x7fca040057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4f0172c89452ebd server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.106+0000 7fd6a9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 0x7fd6ac159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.107+0000 7fd6aad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6ac153b80 0x7fd6ac0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.108+0000 7fd6a9d9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 0x7fd6ac159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43876/0 (socket says 172.21.15.46:43876) 2024-01-27T13:32:52.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.108+0000 7fd6a9d9b640 1 -- 172.21.15.46:0/3170392431 learned_addr learned my addr 172.21.15.46:0/3170392431 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:52.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7fd6a9d9b640 1 -- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6ac153b80 msgr2=0x7fd6ac0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7fd6a9d9b640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6ac153b80 0x7fd6ac0ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7fd6a9d9b640 1 -- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6ac0c8010 msgr2=0x7fd6ac0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7fd6a9d9b640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6ac0c8010 0x7fd6ac0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7fd6a9d9b640 1 -- 172.21.15.46:0/3170392431 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0094d0 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758006d50 con 0x7f2760158090 2024-01-27T13:32:52.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758003970 con 0x7f2760158090 2024-01-27T13:32:52.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2760072af0 con 0x7f2760158090 2024-01-27T13:32:52.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758003d60 con 0x7f2760158090 2024-01-27T13:32:52.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.114+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276014daf0 con 0x7f2760158090 2024-01-27T13:32:52.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.115+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600c0230 con 0x7f2760158090 2024-01-27T13:32:52.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.117+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40035f0 con 0x7f6dd40c7090 2024-01-27T13:32:52.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.117+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4003770 con 0x7f6dd40c7090 2024-01-27T13:32:52.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.117+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4003b20 con 0x7f6dd40c7090 2024-01-27T13:32:52.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.118+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd41efcc0 con 0x7f6dd40c7090 2024-01-27T13:32:52.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.118+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4158fb0 con 0x7f6dd40c7090 2024-01-27T13:32:52.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.118+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd4074410 con 0x7f6dd40c7090 2024-01-27T13:32:52.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.138+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6dc4003c80 con 0x7f6dd40c7090 2024-01-27T13:32:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.139+0000 7f6dcaffd640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6db406af20 0x7f6db406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.139+0000 7f6dcbfff640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6db406af20 0x7f6db406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.139+0000 7f6dcbfff640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6db406af20 0x7f6db406d3e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40cbea0 tx=0x7f6dbc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.141+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6dc4013e70 con 0x7f6dd40c7090 2024-01-27T13:32:52.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.209+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0d0404d3f0 con 0x7f0d081538a0 2024-01-27T13:32:52.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.210+0000 7f0cfe7fc640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0cec06af50 0x7f0cec06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.210+0000 7f0d0d759640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0cec06af50 0x7f0cec06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.210+0000 7f0d0d759640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0cec06af50 0x7f0cec06d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8007fd0 tx=0x7f0cf8007980 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.225+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d0407ab20 con 0x7f0d081538a0 2024-01-27T13:32:52.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.225+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0d04076760 con 0x7f0d081538a0 2024-01-27T13:32:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.235+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011830 con 0x7f41c806c910 2024-01-27T13:32:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.235+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8011990 con 0x7f41c806c910 2024-01-27T13:32:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.235+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011d40 con 0x7f41c806c910 2024-01-27T13:32:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.235+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c815a9f0 con 0x7f41c806c910 2024-01-27T13:32:52.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.235+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c815b410 con 0x7f41c806c910 2024-01-27T13:32:52.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.237+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c8067330 con 0x7f41c806c910 2024-01-27T13:32:52.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.362+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff70c005810 con 0x7ff7200d6ec0 2024-01-27T13:32:52.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.366+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1d2815e0a0 con 0x7f1d280b1d20 2024-01-27T13:32:52.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.369+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f27580052e0 con 0x7f2760158090 2024-01-27T13:32:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.370+0000 7f2755ffb640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274406af00 0x7f274406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.370+0000 7f276530a640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274406af00 0x7f274406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.370+0000 7f276530a640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274406af00 0x7f274406d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2750036000 tx=0x7f2750030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.375+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2758011380 con 0x7f2760158090 2024-01-27T13:32:52.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.395+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f27580550d0 con 0x7f2760158090 2024-01-27T13:32:52.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.395+0000 7fd6a9d9b640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 0x7fd6ac159270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000b4a0 tx=0x7fd6a000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.399+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6dc4053f40 con 0x7f6dd40c7090 2024-01-27T13:32:52.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.399+0000 7f1d1e7fc640 1 -- 172.21.15.46:0/3676262950 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d18021020 con 0x7f1d280b1d20 2024-01-27T13:32:52.392 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-01-27T13:32:52.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.401+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1d0c06aed0 msgr2=0x7f1d0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.401+0000 7f1d301e5640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1d0c06aed0 0x7f1d0c06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d2815b9c0 tx=0x7f1d24009040 comp rx=0 tx=0).stop 2024-01-27T13:32:52.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 msgr2=0x7f1d28153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 0x7f1d28153390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800e9b0 tx=0x7f1d1800ee70 comp rx=0 tx=0).stop 2024-01-27T13:32:52.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 shutdown_connections 2024-01-27T13:32:52.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1d0c06aed0 0x7f1d0c06d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d2815db70 0x7f1d28140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d28157f30 0x7f1d28154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 --2- 172.21.15.46:0/3676262950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1d280b1d20 0x7f1d28153390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 >> 172.21.15.46:0/3676262950 conn(0x7f1d280c8a10 msgr2=0x7f1d280c6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 shutdown_connections 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.402+0000 7f1d301e5640 1 -- 172.21.15.46:0/3676262950 wait complete. 2024-01-27T13:32:52.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.403+0000 7ff716ffd640 1 -- 172.21.15.46:0/446433716 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff728099030 con 0x7ff7200d6ec0 2024-01-27T13:32:52.396 INFO:teuthology.orchestra.run.smithi046.stdout:64424509453 2024-01-27T13:32:52.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.405+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10032600 con 0x7fca18070620 2024-01-27T13:32:52.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.405+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1002e050 con 0x7fca18070620 2024-01-27T13:32:52.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.405+0000 7fca1c8d8640 1 -- 172.21.15.46:0/170532720 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100329c0 con 0x7fca18070620 2024-01-27T13:32:52.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.405+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0010610 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a0010770 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a0010610 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac1f2cf0 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1fb3e640 1 -- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 msgr2=0x7fca0400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/170532720 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca18070620 0x7fca0400b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fca10009860 tx=0x7fca040057f0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1e0db640 1 -- 172.21.15.46:0/170532720 reap_dead start 2024-01-27T13:32:52.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1fb3e640 1 -- 172.21.15.46:0/170532720 shutdown_connections 2024-01-27T13:32:52.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1fb3e640 1 -- 172.21.15.46:0/170532720 >> 172.21.15.46:0/170532720 conn(0x7fca180c8a10 msgr2=0x7fca180c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1fb3e640 1 -- 172.21.15.46:0/170532720 shutdown_connections 2024-01-27T13:32:52.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.406+0000 7fca1fb3e640 1 -- 172.21.15.46:0/170532720 wait complete. 2024-01-27T13:32:52.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.407+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac1f32b0 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.408+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac067c60 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.408+0000 7fca1fb3e640 1 Processor -- start 2024-01-27T13:32:52.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.409+0000 7fca1fb3e640 1 -- start start 2024-01-27T13:32:52.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff70806af50 msgr2=0x7ff70806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7fca1fb3e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca18147c30 0x7fca180c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7fca1fb3e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca180c50e0 0x7fca180c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7fca1fb3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 0x7fca1814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7fca1fb3e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1814b790 con 0x7fca18147c30 2024-01-27T13:32:52.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7fca1fb3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18149670 con 0x7fca18149da0 2024-01-27T13:32:52.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7fca1fb3e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180c5b70 con 0x7fca180c50e0 2024-01-27T13:32:52.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff70806af50 0x7ff70806d410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff71c02ba60 tx=0x7ff71c008030 comp rx=0 tx=0).stop 2024-01-27T13:32:52.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 msgr2=0x7ff7201960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff7201960d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff72804fcc0 tx=0x7ff72806cb00 comp rx=0 tx=0).stop 2024-01-27T13:32:52.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 shutdown_connections 2024-01-27T13:32:52.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff70806af50 0x7ff70806d410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.410+0000 7ff72c968640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7200d6ec0 0x7ff7201960d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.411+0000 7ff72c968640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff72004f7c0 0x7ff7200379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.411+0000 7ff72c968640 1 --2- 172.21.15.46:0/446433716 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff720047750 0x7ff72004c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.411+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 >> 172.21.15.46:0/446433716 conn(0x7ff72000e080 msgr2=0x7ff720047c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.411+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 shutdown_connections 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.411+0000 7ff72c968640 1 -- 172.21.15.46:0/446433716 wait complete. 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.412+0000 7fca1e0db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 0x7fca1814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.412+0000 7fca1e0db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 0x7fca1814a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56562/0 (socket says 172.21.15.46:56562) 2024-01-27T13:32:52.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.412+0000 7fca1e0db640 1 -- 172.21.15.46:0/2709954455 learned_addr learned my addr 172.21.15.46:0/2709954455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:52.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.416+0000 7fca1e0db640 1 -- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca180c50e0 msgr2=0x7fca180c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.4 2024-01-27T13:32:52.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.416+0000 7fca1e0db640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca180c50e0 0x7fca180c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.416+0000 7fca1e0db640 1 -- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca18147c30 msgr2=0x7fca180c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.416+0000 7fca1e0db640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca18147c30 0x7fca180c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.416+0000 7fca1e0db640 1 -- 172.21.15.46:0/2709954455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1814a760 con 0x7fca18149da0 2024-01-27T13:32:52.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.418+0000 7fca1e0db640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 0x7fca1814a220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca10009860 tx=0x7fca100047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.421+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10006d60 con 0x7fca18149da0 2024-01-27T13:32:52.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.421+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca100044a0 con 0x7fca18149da0 2024-01-27T13:32:52.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.421+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1003c650 con 0x7fca18149da0 2024-01-27T13:32:52.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.421+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca180c60a0 con 0x7fca18149da0 2024-01-27T13:32:52.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.422+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca180c47a0 con 0x7fca18149da0 2024-01-27T13:32:52.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.423+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca18074410 con 0x7fca18149da0 2024-01-27T13:32:52.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.3 2024-01-27T13:32:52.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.432+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd6a00108e0 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.433+0000 7fd69affd640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd68c06af90 0x7fd68c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.433+0000 7fd6aa59c640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd68c06af90 0x7fd68c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.433+0000 7fd6aa59c640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd68c06af90 0x7fd68c06d450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd69c036000 tx=0x7fd69c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.437+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd6a0057ec0 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.438+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0d08145ff0 con 0x7f0d081538a0 2024-01-27T13:32:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.529+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f41b8004020 con 0x7f41c806c910 2024-01-27T13:32:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.529+0000 7f41beffd640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f41ac06af50 0x7f41ac06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.529+0000 7f41ce1f4640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f41ac06af50 0x7f41ac06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.530+0000 7f41ce1f4640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f41ac06af50 0x7f41ac06d410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009710 tx=0x7f41c4006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.544+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f41b8021330 con 0x7f41c806c910 2024-01-27T13:32:52.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.544+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f41b80548c0 con 0x7f41c806c910 2024-01-27T13:32:52.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.566+0000 7f0cfe7fc640 1 -- 172.21.15.46:0/2919826803 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d04079d80 con 0x7f0d081538a0 2024-01-27T13:32:52.559 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-01-27T13:32:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0cec06af50 msgr2=0x7f0cec06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0cec06af50 0x7f0cec06d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8007fd0 tx=0x7f0cf8007980 comp rx=0 tx=0).stop 2024-01-27T13:32:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 msgr2=0x7f0d081f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d081f33c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d04000c00 tx=0x7f0d040046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 shutdown_connections 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0cec06af50 0x7f0cec06d410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d0815da10 0x7f0d08152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d08159770 0x7f0d08148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 --2- 172.21.15.46:0/2919826803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d081538a0 0x7f0d081f33c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 >> 172.21.15.46:0/2919826803 conn(0x7f0d0806b820 msgr2=0x7f0d080c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 shutdown_connections 2024-01-27T13:32:52.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.569+0000 7f0d101be640 1 -- 172.21.15.46:0/2919826803 wait complete. 2024-01-27T13:32:52.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.7 2024-01-27T13:32:52.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.626+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2760074410 con 0x7f2760158090 2024-01-27T13:32:52.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.642+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6dd40c6850 con 0x7f6dd40c7090 2024-01-27T13:32:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.671+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fca10039050 con 0x7fca18149da0 2024-01-27T13:32:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.672+0000 7fca0e7fc640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc9fc06af20 0x7fc9fc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.672+0000 7fca1d8da640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc9fc06af20 0x7fc9fc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:52.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.672+0000 7fca1d8da640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc9fc06af20 0x7fc9fc06d3e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca14002230 tx=0x7fca14001880 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:52.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.675+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fca10079570 con 0x7fca18149da0 2024-01-27T13:32:52.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.682+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd6a0054200 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.686+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fca100751b0 con 0x7fca18149da0 2024-01-27T13:32:52.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.742+0000 7f2755ffb640 1 -- 172.21.15.46:0/904323371 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27580586f0 con 0x7f2760158090 2024-01-27T13:32:52.735 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-01-27T13:32:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.744+0000 7f6dcaffd640 1 -- 172.21.15.46:0/148316705 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6dc4017020 con 0x7f6dd40c7090 2024-01-27T13:32:52.736 INFO:teuthology.orchestra.run.smithi046.stdout:64424509453 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274406af00 msgr2=0x7f274406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274406af00 0x7f274406d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2750036000 tx=0x7f2750030000 comp rx=0 tx=0).stop 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 msgr2=0x7f27601470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 0x7f27601470d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f275800c730 tx=0x7f275800cbf0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 shutdown_connections 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f274406af00 0x7f274406d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2760158090 0x7f27601470d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27600715d0 0x7f2760160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 --2- 172.21.15.46:0/904323371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f276006ce50 0x7f276015cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 >> 172.21.15.46:0/904323371 conn(0x7f27600cae90 msgr2=0x7f27600ca230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.745+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 shutdown_connections 2024-01-27T13:32:52.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f276756e640 1 -- 172.21.15.46:0/904323371 wait complete. 2024-01-27T13:32:52.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6db406af20 msgr2=0x7f6db406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6db406af20 0x7f6db406d3e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40cbea0 tx=0x7f6dbc008040 comp rx=0 tx=0).stop 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 msgr2=0x7f6dd413c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 0x7f6dd413c6c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c410 tx=0x7f6dc400c8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 shutdown_connections 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6db406af20 0x7f6db406d3e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dd40c7920 0x7f6dd41f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6dd40c7470 0x7f6dd406a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 --2- 172.21.15.46:0/148316705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6dd40c7090 0x7f6dd413c6c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 >> 172.21.15.46:0/148316705 conn(0x7f6dd40c8a10 msgr2=0x7f6dd4142940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 shutdown_connections 2024-01-27T13:32:52.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.746+0000 7f6dd8c90640 1 -- 172.21.15.46:0/148316705 wait complete. 2024-01-27T13:32:52.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.6 2024-01-27T13:32:52.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.1 2024-01-27T13:32:52.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.790+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f41c80b4430 con 0x7f41c806c910 2024-01-27T13:32:52.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.848+0000 7f41beffd640 1 -- 172.21.15.46:0/4098653158 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41b8015020 con 0x7f41c806c910 2024-01-27T13:32:52.841 INFO:teuthology.orchestra.run.smithi046.stdout:55834574861 2024-01-27T13:32:52.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f41ac06af50 msgr2=0x7f41ac06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f41ac06af50 0x7f41ac06d410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009710 tx=0x7f41c4006c90 comp rx=0 tx=0).stop 2024-01-27T13:32:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 msgr2=0x7f41c814a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c814a8d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b410 tx=0x7f41b800b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 shutdown_connections 2024-01-27T13:32:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f41ac06af50 0x7f41ac06d410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f41c8153a70 0x7f41c814b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41c806c910 0x7f41c814a8d0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b410 tx=0x7f41b800b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 --2- 172.21.15.46:0/4098653158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41c806c4f0 0x7f41c815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 >> 172.21.15.46:0/4098653158 conn(0x7f41c808b600 msgr2=0x7f41c80b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 shutdown_connections 2024-01-27T13:32:52.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.851+0000 7f41d0458640 1 -- 172.21.15.46:0/4098653158 wait complete. 2024-01-27T13:32:52.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2024-01-27T13:32:52.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.875+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6ac074410 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.885+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fca180c10b0 con 0x7fca18149da0 2024-01-27T13:32:52.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.910+0000 7fca0e7fc640 1 -- 172.21.15.46:0/2709954455 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca10037030 con 0x7fca18149da0 2024-01-27T13:32:52.903 INFO:teuthology.orchestra.run.smithi046.stdout:60129542156 2024-01-27T13:32:52.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc9fc06af20 msgr2=0x7fc9fc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc9fc06af20 0x7fc9fc06d3e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca14002230 tx=0x7fca14001880 comp rx=0 tx=0).stop 2024-01-27T13:32:52.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 msgr2=0x7fca1814a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 0x7fca1814a220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca10009860 tx=0x7fca100047d0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 shutdown_connections 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc9fc06af20 0x7fc9fc06d3e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca18149da0 0x7fca1814a220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fca180c50e0 0x7fca180c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 --2- 172.21.15.46:0/2709954455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca18147c30 0x7fca180c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 >> 172.21.15.46:0/2709954455 conn(0x7fca180c8a10 msgr2=0x7fca180c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 shutdown_connections 2024-01-27T13:32:52.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.912+0000 7fca1fb3e640 1 -- 172.21.15.46:0/2709954455 wait complete. 2024-01-27T13:32:52.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.918+0000 7fd69affd640 1 -- 172.21.15.46:0/3170392431 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd6a001e090 con 0x7fd6ac0c99d0 2024-01-27T13:32:52.910 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd68c06af90 msgr2=0x7fd68c06d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd68c06af90 0x7fd68c06d450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd69c036000 tx=0x7fd69c030000 comp rx=0 tx=0).stop 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 msgr2=0x7fd6ac159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 0x7fd6ac159270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000b4a0 tx=0x7fd6a000b960 comp rx=0 tx=0).stop 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 shutdown_connections 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd68c06af90 0x7fd68c06d450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6ac153b80 0x7fd6ac0ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd6ac0c99d0 0x7fd6ac159270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 --2- 172.21.15.46:0/3170392431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6ac0c8010 0x7fd6ac0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:52.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 >> 172.21.15.46:0/3170392431 conn(0x7fd6ac0cf230 msgr2=0x7fd6ac0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:52.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 shutdown_connections 2024-01-27T13:32:52.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:52.920+0000 7fd6b0e3d640 1 -- 172.21.15.46:0/3170392431 wait complete. 2024-01-27T13:32:52.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.5 2024-01-27T13:32:52.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.2 2024-01-27T13:32:52.925 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:53.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-27T13:32:53.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-27T13:32:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.530+0000 7f1695fe3640 1 Processor -- start 2024-01-27T13:32:53.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.530+0000 7f1695fe3640 1 -- start start 2024-01-27T13:32:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.530+0000 7f1695fe3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16900c77d0 0x7f16900c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.530+0000 7f1695fe3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c8580 0x7f1690159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f1695fe3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16900c9480 con 0x7f1690153a50 2024-01-27T13:32:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f1695fe3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16900c9740 con 0x7f16900c77d0 2024-01-27T13:32:53.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f1695fe3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16900c9290 con 0x7f16900c8580 2024-01-27T13:32:53.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f168effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16900c77d0 0x7f16900c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f168effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16900c77d0 0x7f16900c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49814/0 (socket says 172.21.15.46:49814) 2024-01-27T13:32:53.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f168effd640 1 -- 172.21.15.46:0/333444271 learned_addr learned my addr 172.21.15.46:0/333444271 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.531+0000 7f168ffff640 1 --2- 172.21.15.46:0/333444271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c8580 0x7f1690159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.534+0000 7f168effd640 1 -- 172.21.15.46:0/333444271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c8580 msgr2=0x7f1690159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.534+0000 7f168effd640 1 --2- 172.21.15.46:0/333444271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c8580 0x7f1690159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.534+0000 7f168effd640 1 -- 172.21.15.46:0/333444271 >> v1:172.21.15.78:6789/0 conn(0x7f1690153a50 legacy=0x7f16900c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.534+0000 7f168effd640 1 -- 172.21.15.46:0/333444271 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169006bfb0 con 0x7f16900c77d0 2024-01-27T13:32:53.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.536+0000 7f168effd640 1 --2- 172.21.15.46:0/333444271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16900c77d0 0x7f16900c8040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1684009870 tx=0x7f168402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0d350493f50b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.540+0000 7f168e7fc640 1 -- 172.21.15.46:0/333444271 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168402f840 con 0x7f16900c77d0 2024-01-27T13:32:53.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.540+0000 7f168e7fc640 1 -- 172.21.15.46:0/333444271 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168402f9a0 con 0x7f16900c77d0 2024-01-27T13:32:53.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.540+0000 7f168e7fc640 1 -- 172.21.15.46:0/333444271 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168402fd30 con 0x7f16900c77d0 2024-01-27T13:32:53.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 -- 172.21.15.46:0/333444271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16900c77d0 msgr2=0x7f16900c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 --2- 172.21.15.46:0/333444271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16900c77d0 0x7f16900c8040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1684009870 tx=0x7f168402ba20 comp rx=0 tx=0).stop 2024-01-27T13:32:53.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 -- 172.21.15.46:0/333444271 shutdown_connections 2024-01-27T13:32:53.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 --2- 172.21.15.46:0/333444271 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c8580 0x7f1690159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 --2- 172.21.15.46:0/333444271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16900c77d0 0x7f16900c8040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 -- 172.21.15.46:0/333444271 >> 172.21.15.46:0/333444271 conn(0x7f169006efe0 msgr2=0x7f169006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:53.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 -- 172.21.15.46:0/333444271 shutdown_connections 2024-01-27T13:32:53.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.541+0000 7f1695fe3640 1 -- 172.21.15.46:0/333444271 wait complete. 2024-01-27T13:32:53.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.543+0000 7f1695fe3640 1 Processor -- start 2024-01-27T13:32:53.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.543+0000 7f1695fe3640 1 -- start start 2024-01-27T13:32:53.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.544+0000 7f1695fe3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c77d0 0x7f16900c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.544+0000 7f1695fe3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16900c8580 0x7f1690155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.544+0000 7f1695fe3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1690153a50 0x7f1690156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.544+0000 7f1695fe3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900cb1b0 con 0x7f1690153a50 2024-01-27T13:32:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.544+0000 7f1695fe3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16900cac30 con 0x7f16900c8580 2024-01-27T13:32:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.544+0000 7f1695fe3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16901f3380 con 0x7f16900c77d0 2024-01-27T13:32:53.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.545+0000 7f168effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16900c8580 0x7f1690155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.545+0000 7f168ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1690153a50 0x7f1690156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.545+0000 7f168ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1690153a50 0x7f1690156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49824/0 (socket says 172.21.15.46:49824) 2024-01-27T13:32:53.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.545+0000 7f168ffff640 1 -- 172.21.15.46:0/669654831 learned_addr learned my addr 172.21.15.46:0/669654831 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.549+0000 7f168effd640 1 -- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c77d0 msgr2=0x7f16900c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.549+0000 7f168effd640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c77d0 0x7f16900c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.549+0000 7f168effd640 1 -- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1690153a50 msgr2=0x7f1690156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.549+0000 7f168effd640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1690153a50 0x7f1690156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.549+0000 7f168effd640 1 -- 172.21.15.46:0/669654831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16840094d0 con 0x7f16900c8580 2024-01-27T13:32:53.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.551+0000 7f168effd640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16900c8580 0x7f1690155ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1684033000 tx=0x7f1684004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.555+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684037bc0 con 0x7f16900c8580 2024-01-27T13:32:53.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.555+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684037d20 con 0x7f16900c8580 2024-01-27T13:32:53.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.555+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684041640 con 0x7f16900c8580 2024-01-27T13:32:53.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.555+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16901520c0 con 0x7f16900c8580 2024-01-27T13:32:53.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.555+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16900caed0 con 0x7f16900c8580 2024-01-27T13:32:53.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.556+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1690074410 con 0x7f16900c8580 2024-01-27T13:32:53.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.571+0000 7fbf75e5d640 1 Processor -- start 2024-01-27T13:32:53.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.571+0000 7fbf75e5d640 1 -- start start 2024-01-27T13:32:53.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.572+0000 7fbf75e5d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf70153a70 0x7fbf700c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.572+0000 7fbf75e5d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf7015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.572+0000 7fbf75e5d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf700c3f90 con 0x7fbf7006c4f0 2024-01-27T13:32:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.572+0000 7fbf75e5d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7006cd40 con 0x7fbf70153a70 2024-01-27T13:32:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.572+0000 7fbf75e5d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7006c060 con 0x7fbf7006c910 2024-01-27T13:32:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.573+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf7015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.573+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf7015d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43922/0 (socket says 172.21.15.46:43922) 2024-01-27T13:32:53.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.573+0000 7fbf6ffff640 1 -- 172.21.15.46:0/2801558686 learned_addr learned my addr 172.21.15.46:0/2801558686 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.575+0000 7fbf6ffff640 1 -- 172.21.15.46:0/2801558686 >> v2:172.21.15.78:3300/0 conn(0x7fbf70153a70 msgr2=0x7fbf700c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.575+0000 7fbf6ffff640 1 --2- 172.21.15.46:0/2801558686 >> v2:172.21.15.78:3300/0 conn(0x7fbf70153a70 0x7fbf700c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.576+0000 7fbf6ffff640 1 -- 172.21.15.46:0/2801558686 >> v1:172.21.15.46:6789/0 conn(0x7fbf7006c4f0 legacy=0x7fbf7015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.576+0000 7fbf6ffff640 1 -- 172.21.15.46:0/2801558686 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf700670d0 con 0x7fbf7006c910 2024-01-27T13:32:53.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.576+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f16840417a0 con 0x7f16900c8580 2024-01-27T13:32:53.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.577+0000 7f1677fff640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f167c06aed0 0x7f167c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.577+0000 7f168f7fe640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f167c06aed0 0x7f167c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.577+0000 7f168f7fe640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f167c06aed0 0x7f167c06d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1680000f60 tx=0x7f16800079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.578+0000 7fbf6ffff640 1 --2- 172.21.15.46:0/2801558686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf7015d530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009e50 tx=0x7fbf6802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3321d2bb1a43ca server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.580+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f168403c070 con 0x7f16900c8580 2024-01-27T13:32:53.574 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-27T13:32:53.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.582+0000 7fbf6e7fc640 1 -- 172.21.15.46:0/2801558686 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6802c9e0 con 0x7fbf7006c910 2024-01-27T13:32:53.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.582+0000 7fbf6e7fc640 1 -- 172.21.15.46:0/2801558686 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6802cb40 con 0x7fbf7006c910 2024-01-27T13:32:53.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.582+0000 7fbf6e7fc640 1 -- 172.21.15.46:0/2801558686 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf680343f0 con 0x7fbf7006c910 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 -- 172.21.15.46:0/2801558686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 msgr2=0x7fbf7015d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/2801558686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf7015d530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009e50 tx=0x7fbf6802be40 comp rx=0 tx=0).stop 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 -- 172.21.15.46:0/2801558686 shutdown_connections 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/2801558686 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf7015d530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/2801558686 >> v2:172.21.15.78:3300/0 conn(0x7fbf70153a70 0x7fbf700c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 -- 172.21.15.46:0/2801558686 >> 172.21.15.46:0/2801558686 conn(0x7fbf7008b600 msgr2=0x7fbf700663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 -- 172.21.15.46:0/2801558686 shutdown_connections 2024-01-27T13:32:53.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.583+0000 7fbf75e5d640 1 -- 172.21.15.46:0/2801558686 wait complete. 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 Processor -- start 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 -- start start 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf7006c4f0 0x7fbf70155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf700c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 0x7fbf700c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7015dba0 con 0x7fbf70153a70 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf700c75d0 con 0x7fbf7006c4f0 2024-01-27T13:32:53.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.585+0000 7fbf75e5d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf70155760 con 0x7fbf7006c910 2024-01-27T13:32:53.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.587+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 0x7fbf700c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.588+0000 7fbf6ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 0x7fbf700c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49836/0 (socket says 172.21.15.46:49836) 2024-01-27T13:32:53.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.588+0000 7fbf6ffff640 1 -- 172.21.15.46:0/679695672 learned_addr learned my addr 172.21.15.46:0/679695672 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.589+0000 7fbf6effd640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf700c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.592+0000 7fbf6ffff640 1 -- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 msgr2=0x7fbf700c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.592+0000 7fbf6ffff640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf700c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.592+0000 7fbf6ffff640 1 -- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf7006c4f0 msgr2=0x7fbf70155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.592+0000 7fbf6ffff640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf7006c4f0 0x7fbf70155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.592+0000 7fbf6ffff640 1 -- 172.21.15.46:0/679695672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009b30 con 0x7fbf70153a70 2024-01-27T13:32:53.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.594+0000 7fbf6ffff640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 0x7fbf700c6a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf68036040 tx=0x7fbf68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.618+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6803e450 con 0x7fbf70153a70 2024-01-27T13:32:53.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.618+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6803e5d0 con 0x7fbf70153a70 2024-01-27T13:32:53.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.618+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf700c8e30 con 0x7fbf70153a70 2024-01-27T13:32:53.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.619+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6803e980 con 0x7fbf70153a70 2024-01-27T13:32:53.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.619+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf700c87e0 con 0x7fbf70153a70 2024-01-27T13:32:53.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.620+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf70067330 con 0x7fbf70153a70 2024-01-27T13:32:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.641+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbf6803eae0 con 0x7fbf70153a70 2024-01-27T13:32:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.642+0000 7fbf57fff640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbf5c06af20 0x7fbf5c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.642+0000 7fbf6f7fe640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbf5c06af20 0x7fbf5c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.642+0000 7fbf6f7fe640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbf5c06af20 0x7fbf5c06d3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009670 tx=0x7fbf60006bf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.644+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf68040e70 con 0x7fbf70153a70 2024-01-27T13:32:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.687+0000 7fd2415e3640 1 Processor -- start 2024-01-27T13:32:53.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 -- start start 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd23c0c28c0 0x7fd23c0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd23c0c2ca0 0x7fd23c1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 0x7fd23c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0ccf60 con 0x7fd23c0c2ca0 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0ca800 con 0x7fd23c0c28c0 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.688+0000 7fd2415e3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1576d0 con 0x7fd23c0c77d0 2024-01-27T13:32:53.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.689+0000 7fd23b7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 0x7fd23c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.689+0000 7fd23b7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 0x7fd23c151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43952/0 (socket says 172.21.15.46:43952) 2024-01-27T13:32:53.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.689+0000 7fd23b7fe640 1 -- 172.21.15.46:0/2840900701 learned_addr learned my addr 172.21.15.46:0/2840900701 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.691+0000 7fd23b7fe640 1 -- 172.21.15.46:0/2840900701 >> v2:172.21.15.78:3300/0 conn(0x7fd23c0c28c0 msgr2=0x7fd23c0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.691+0000 7fd23b7fe640 1 --2- 172.21.15.46:0/2840900701 >> v2:172.21.15.78:3300/0 conn(0x7fd23c0c28c0 0x7fd23c0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.691+0000 7fd23b7fe640 1 -- 172.21.15.46:0/2840900701 >> v2:172.21.15.46:3300/0 conn(0x7fd23c0c2ca0 msgr2=0x7fd23c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.691+0000 7fd23b7fe640 1 --2- 172.21.15.46:0/2840900701 >> v2:172.21.15.46:3300/0 conn(0x7fd23c0c2ca0 0x7fd23c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.691+0000 7fd23b7fe640 1 -- 172.21.15.46:0/2840900701 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0cd200 con 0x7fd23c0c77d0 2024-01-27T13:32:53.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.693+0000 7fd23b7fe640 1 --2- 172.21.15.46:0/2840900701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 0x7fd23c151a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0718d0 tx=0x7fd23402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61ab8e1b05893d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd239ffb640 1 -- 172.21.15.46:0/2840900701 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23402caa0 con 0x7fd23c0c77d0 2024-01-27T13:32:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd239ffb640 1 -- 172.21.15.46:0/2840900701 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23402cc00 con 0x7fd23c0c77d0 2024-01-27T13:32:53.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd239ffb640 1 -- 172.21.15.46:0/2840900701 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2340343f0 con 0x7fd23c0c77d0 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 -- 172.21.15.46:0/2840900701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 msgr2=0x7fd23c151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 --2- 172.21.15.46:0/2840900701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 0x7fd23c151a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0718d0 tx=0x7fd23402bf00 comp rx=0 tx=0).stop 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 -- 172.21.15.46:0/2840900701 shutdown_connections 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 --2- 172.21.15.46:0/2840900701 >> v2:172.21.15.46:3300/0 conn(0x7fd23c0c2ca0 0x7fd23c1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 --2- 172.21.15.46:0/2840900701 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c77d0 0x7fd23c151a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 --2- 172.21.15.46:0/2840900701 >> v2:172.21.15.78:3300/0 conn(0x7fd23c0c28c0 0x7fd23c0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 -- 172.21.15.46:0/2840900701 >> 172.21.15.46:0/2840900701 conn(0x7fd23c06efe0 msgr2=0x7fd23c06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 -- 172.21.15.46:0/2840900701 shutdown_connections 2024-01-27T13:32:53.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.698+0000 7fd2415e3640 1 -- 172.21.15.46:0/2840900701 wait complete. 2024-01-27T13:32:53.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.699+0000 7fd2415e3640 1 Processor -- start 2024-01-27T13:32:53.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 -- start start 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 0x7fd23c14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd23c0c2ca0 0x7fd23c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd23c0c77d0 0x7fd23c1ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c14a240 con 0x7fd23c0c2ca0 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1ef400 con 0x7fd23c0c77d0 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.700+0000 7fd2415e3640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1f3420 con 0x7fd23c0c28c0 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.701+0000 7fd23affd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 0x7fd23c14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.701+0000 7fd23affd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 0x7fd23c14b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43962/0 (socket says 172.21.15.46:43962) 2024-01-27T13:32:53.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.701+0000 7fd23affd640 1 -- 172.21.15.46:0/361916477 learned_addr learned my addr 172.21.15.46:0/361916477 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.704+0000 7fd23affd640 1 -- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd23c0c77d0 msgr2=0x7fd23c1ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.704+0000 7fd23affd640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd23c0c77d0 0x7fd23c1ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.704+0000 7fd23affd640 1 -- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd23c0c2ca0 msgr2=0x7fd23c14bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.704+0000 7fd23affd640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd23c0c2ca0 0x7fd23c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.704+0000 7fd23affd640 1 -- 172.21.15.46:0/361916477 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234009b30 con 0x7fd23c0c28c0 2024-01-27T13:32:53.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.707+0000 7fd23affd640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 0x7fd23c14b620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00b440 tx=0x7fd22c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.711+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011830 con 0x7fd23c0c28c0 2024-01-27T13:32:53.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.711+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c011990 con 0x7fd23c0c28c0 2024-01-27T13:32:53.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.711+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0cadb0 con 0x7fd23c0c28c0 2024-01-27T13:32:53.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.711+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011d40 con 0x7fd23c0c28c0 2024-01-27T13:32:53.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.711+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c067160 con 0x7fd23c0c28c0 2024-01-27T13:32:53.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.712+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0ca350 con 0x7fd23c0c28c0 2024-01-27T13:32:53.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.735+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd22c01b460 con 0x7fd23c0c28c0 2024-01-27T13:32:53.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.736+0000 7fd2237fe640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd22806af20 0x7fd22806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.736+0000 7fd23a7fc640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd22806af20 0x7fd22806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.736+0000 7fd23a7fc640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd22806af20 0x7fd22806d3e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b1cf0 tx=0x7fd230006c10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.738+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd22c0591e0 con 0x7fd23c0c28c0 2024-01-27T13:32:53.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-27T13:32:53.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-27T13:32:53.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.844+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1684077e10 con 0x7f16900c8580 2024-01-27T13:32:53.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-27T13:32:53.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.876+0000 7f1ace389640 1 Processor -- start 2024-01-27T13:32:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.876+0000 7f1ace389640 1 -- start start 2024-01-27T13:32:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.877+0000 7f1ace389640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ac80c8f00 0x7f1ac80cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.877+0000 7f1ace389640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac80ca9f0 con 0x7f1ac80cf550 2024-01-27T13:32:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.877+0000 7f1ace389640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac8159d50 con 0x7f1ac80c92e0 2024-01-27T13:32:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.877+0000 7f1ace389640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80cc9c0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.878+0000 7f1ac7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ac80c8f00 0x7f1ac80cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.878+0000 7f1ac7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1ac80c8f00 0x7f1ac80cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56614/0 (socket says 172.21.15.46:56614) 2024-01-27T13:32:53.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.878+0000 7f1ac7fff640 1 -- 172.21.15.46:0/3544355341 learned_addr learned my addr 172.21.15.46:0/3544355341 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.881+0000 7f1ac7fff640 1 -- 172.21.15.46:0/3544355341 >> v1:172.21.15.78:6789/0 conn(0x7f1ac80c92e0 legacy=0x7f1ac815cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.881+0000 7f1ac7fff640 1 -- 172.21.15.46:0/3544355341 >> v1:172.21.15.46:6789/0 conn(0x7f1ac80cf550 legacy=0x7f1ac80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.881+0000 7f1ac7fff640 1 -- 172.21.15.46:0/3544355341 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80cc6e0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.884+0000 7f1ac7fff640 1 --2- 172.21.15.46:0/3544355341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac80cf010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009870 tx=0x7f1ab802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2ca148ef6f4a4b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.888+0000 7f1ac6ffd640 1 -- 172.21.15.46:0/3544355341 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab802f840 con 0x7f1ac80c8f00 2024-01-27T13:32:53.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.888+0000 7f1ac6ffd640 1 -- 172.21.15.46:0/3544355341 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab802f9a0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.888+0000 7f1ac6ffd640 1 -- 172.21.15.46:0/3544355341 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab802fd30 con 0x7f1ac80c8f00 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.889+0000 7f1ace389640 1 -- 172.21.15.46:0/3544355341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 msgr2=0x7f1ac80cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.889+0000 7f1ace389640 1 --2- 172.21.15.46:0/3544355341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac80cf010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009870 tx=0x7f1ab802ba20 comp rx=0 tx=0).stop 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.889+0000 7f1ace389640 1 -- 172.21.15.46:0/3544355341 shutdown_connections 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.889+0000 7f1ace389640 1 --2- 172.21.15.46:0/3544355341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac80cf010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.889+0000 7f1ace389640 1 -- 172.21.15.46:0/3544355341 >> 172.21.15.46:0/3544355341 conn(0x7f1ac808afd0 msgr2=0x7f1ac808b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.890+0000 7f1ace389640 1 -- 172.21.15.46:0/3544355341 shutdown_connections 2024-01-27T13:32:53.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.890+0000 7f1ace389640 1 -- 172.21.15.46:0/3544355341 wait complete. 2024-01-27T13:32:53.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.891+0000 7f1ace389640 1 Processor -- start 2024-01-27T13:32:53.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.892+0000 7f1ace389640 1 -- start start 2024-01-27T13:32:53.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ace389640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ace389640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac80c92e0 0x7f1ac81e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ace389640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ac80cf550 0x7f1ac81e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ace389640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81e4780 con 0x7f1ac80c92e0 2024-01-27T13:32:53.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ace389640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac814e4a0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ace389640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81e42f0 con 0x7f1ac80cf550 2024-01-27T13:32:53.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.893+0000 7f1ac7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.894+0000 7f1ac7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac8159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56616/0 (socket says 172.21.15.46:56616) 2024-01-27T13:32:53.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.894+0000 7f1ac7fff640 1 -- 172.21.15.46:0/259318545 learned_addr learned my addr 172.21.15.46:0/259318545 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.897+0000 7f1ac7fff640 1 -- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ac80cf550 msgr2=0x7f1ac81e20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.897+0000 7f1ac7fff640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ac80cf550 0x7f1ac81e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.897+0000 7f1ac7fff640 1 -- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac80c92e0 msgr2=0x7f1ac81e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.897+0000 7f1ac7fff640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac80c92e0 0x7f1ac81e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.897+0000 7f1ac7fff640 1 -- 172.21.15.46:0/259318545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80094d0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.900+0000 7f1ac7fff640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac8159480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8000c00 tx=0x7f1ab8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.903+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8037d10 con 0x7f1ac80c8f00 2024-01-27T13:32:53.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.903+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab8037e70 con 0x7f1ac80c8f00 2024-01-27T13:32:53.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.903+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8041600 con 0x7f1ac80c8f00 2024-01-27T13:32:53.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.904+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac81544b0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.904+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac81f0070 con 0x7f1ac80c8f00 2024-01-27T13:32:53.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.905+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac81e40a0 con 0x7f1ac80c8f00 2024-01-27T13:32:53.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.917+0000 7fe312c90640 1 Processor -- start 2024-01-27T13:32:53.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.917+0000 7fe312c90640 1 -- start start 2024-01-27T13:32:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.919+0000 7fe312c90640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe30c0c7470 0x7fe30c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.919+0000 7fe312c90640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.919+0000 7fe312c90640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c15a8c0 con 0x7fe30c0c7090 2024-01-27T13:32:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.919+0000 7fe312c90640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c0700b0 con 0x7fe30c0c7470 2024-01-27T13:32:53.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.919+0000 7fe312c90640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c15a5e0 con 0x7fe30c0c7920 2024-01-27T13:32:53.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.922+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbf68077a60 con 0x7fbf70153a70 2024-01-27T13:32:53.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.923+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1ab8041760 con 0x7f1ac80c8f00 2024-01-27T13:32:53.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.924+0000 7f1ac4ff9640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ab406aed0 0x7f1ab406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.924+0000 7f1ac77fe640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ab406aed0 0x7f1ab406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-27T13:32:53.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.925+0000 7f1ac77fe640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ab406aed0 0x7f1ab406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1abc000f60 tx=0x7f1abc0079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.985+0000 7f3434961640 1 Processor -- start 2024-01-27T13:32:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.985+0000 7f3434961640 1 -- start start 2024-01-27T13:32:53.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.986+0000 7f3434961640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3430151c00 0x7f3430157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.986+0000 7f3434961640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300ccf60 con 0x7f34300c2ca0 2024-01-27T13:32:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.987+0000 7f3434961640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300ca800 con 0x7f34300c28c0 2024-01-27T13:32:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.987+0000 7f3434961640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34301576d0 con 0x7f3430151c00 2024-01-27T13:32:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.987+0000 7f342dd9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f34300c2ca0 0x7f34301514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:40438/0 (socket says 172.21.15.46:40438) 2024-01-27T13:32:53.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.987+0000 7f342dd9b640 1 -- 172.21.15.46:0/996057959 learned_addr learned my addr 172.21.15.46:0/996057959 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.990+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446265075 0 0) 0x7f34300ccf60 con 0x7f34300c2ca0 2024-01-27T13:32:53.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.990+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3418003520 con 0x7f34300c2ca0 2024-01-27T13:32:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.996+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944752811 0 0) 0x7f3418003520 con 0x7f34300c2ca0 2024-01-27T13:32:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 >> v2:172.21.15.78:3300/0 conn(0x7f3430151c00 msgr2=0x7f3430157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 --2- 172.21.15.46:0/996057959 >> v2:172.21.15.78:3300/0 conn(0x7f3430151c00 0x7f3430157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:53.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 >> v1:172.21.15.78:6789/0 conn(0x7f34300c28c0 legacy=0x7f34300c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300cd200 con 0x7f34300c2ca0 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2887288732 0 0) 0x7f3424001670 con 0x7f34300c2ca0 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 >> v1:172.21.15.46:6789/0 conn(0x7f34300c2ca0 legacy=0x7f34301514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34180039c0 0x7f3418003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34180047c0 0x7f3418004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180052a0 0x7f341800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34301576d0 con 0x7f34180052a0 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341800c1f0 con 0x7f34180039c0 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.997+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341800c3b0 con 0x7f34180047c0 2024-01-27T13:32:53.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:53.998+0000 7f342ed9d640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180052a0 0x7f341800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.000+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd22c054e20 con 0x7fd23c0c28c0 2024-01-27T13:32:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.001+0000 7f342dd9b640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34180047c0 0x7f3418004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.003+0000 7fe31122d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:53.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.005+0000 7fe31122d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43974/0 (socket says 172.21.15.46:43974) 2024-01-27T13:32:53.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.005+0000 7fe31122d640 1 -- 172.21.15.46:0/1144542304 learned_addr learned my addr 172.21.15.46:0/1144542304 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:54.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.008+0000 7f342dd9b640 1 -- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34180039c0 msgr2=0x7f3418003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:54.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.008+0000 7f342dd9b640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34180039c0 0x7f3418003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.008+0000 7f342dd9b640 1 -- 172.21.15.46:0/996057959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180052a0 msgr2=0x7f341800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:54.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.008+0000 7f342dd9b640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180052a0 0x7f341800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.008+0000 7f342ed9d640 1 -- 172.21.15.46:0/996057959 reap_dead start 2024-01-27T13:32:54.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.008+0000 7f342dd9b640 1 -- 172.21.15.46:0/996057959 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418003520 con 0x7f34180047c0 2024-01-27T13:32:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.013+0000 7fe31122d640 1 -- 172.21.15.46:0/1144542304 >> v2:172.21.15.78:3300/0 conn(0x7fe30c0c7470 msgr2=0x7fe30c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.014+0000 7fe31122d640 1 --2- 172.21.15.46:0/1144542304 >> v2:172.21.15.78:3300/0 conn(0x7fe30c0c7470 0x7fe30c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.014+0000 7fe31122d640 1 -- 172.21.15.46:0/1144542304 >> v1:172.21.15.78:6789/0 conn(0x7fe30c0c7090 legacy=0x7fe30c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.014+0000 7fe31122d640 1 -- 172.21.15.46:0/1144542304 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0c0fd0 con 0x7fe30c0c7920 2024-01-27T13:32:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.015+0000 7f342dd9b640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34180047c0 0x7f3418004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34300c30b0 tx=0x7f34180057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70aa0c0f95583aa server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.018+0000 7fe31122d640 1 --2- 172.21.15.46:0/1144542304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c159f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe30400d150 tx=0x7fe30402e180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dabd95f03e8ad9e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.022+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424005ad0 con 0x7f34180047c0 2024-01-27T13:32:54.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.026+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3424005c30 con 0x7f34180047c0 2024-01-27T13:32:54.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.026+0000 7f342d59a640 1 -- 172.21.15.46:0/996057959 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424007070 con 0x7f34180047c0 2024-01-27T13:32:54.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 -- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34180047c0 msgr2=0x7f3418004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34180047c0 0x7f3418004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f34300c30b0 tx=0x7f34180057f0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 -- 172.21.15.46:0/996057959 shutdown_connections 2024-01-27T13:32:54.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 --2- 172.21.15.46:0/996057959 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f34180047c0 0x7f3418004c40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 -- 172.21.15.46:0/996057959 >> 172.21.15.46:0/996057959 conn(0x7f343006efe0 msgr2=0x7f343006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 -- 172.21.15.46:0/996057959 shutdown_connections 2024-01-27T13:32:54.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7f3434961640 1 -- 172.21.15.46:0/996057959 wait complete. 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7fe30b7fe640 1 -- 172.21.15.46:0/1144542304 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30400b0d0 con 0x7fe30c0c7920 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7fe30b7fe640 1 -- 172.21.15.46:0/1144542304 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400b230 con 0x7fe30c0c7920 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.027+0000 7fe30b7fe640 1 -- 172.21.15.46:0/1144542304 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304009600 con 0x7fe30c0c7920 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 -- 172.21.15.46:0/1144542304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 msgr2=0x7fe30c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 --2- 172.21.15.46:0/1144542304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c159f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe30400d150 tx=0x7fe30402e180 comp rx=0 tx=0).stop 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 -- 172.21.15.46:0/1144542304 shutdown_connections 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 --2- 172.21.15.46:0/1144542304 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c159f90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 --2- 172.21.15.46:0/1144542304 >> v2:172.21.15.78:3300/0 conn(0x7fe30c0c7470 0x7fe30c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 -- 172.21.15.46:0/1144542304 >> 172.21.15.46:0/1144542304 conn(0x7fe30c0c8a10 msgr2=0x7fe30c0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 -- 172.21.15.46:0/1144542304 shutdown_connections 2024-01-27T13:32:54.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.028+0000 7fe312c90640 1 -- 172.21.15.46:0/1144542304 wait complete. 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.029+0000 7f3434961640 1 Processor -- start 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.029+0000 7f3434961640 1 -- start start 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.029+0000 7f3434961640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180047c0 0x7f343014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.029+0000 7f3434961640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3430154d60 0x7f3430153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7f3434961640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f343014c750 0x7f343014cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7f3434961640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343014eb60 con 0x7f34180047c0 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7f3434961640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3430153c00 con 0x7f343014c750 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7f3434961640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343014e690 con 0x7f3430154d60 2024-01-27T13:32:54.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7f342e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180047c0 0x7f343014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7fe312c90640 1 Processor -- start 2024-01-27T13:32:54.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.030+0000 7fe312c90640 1 -- start start 2024-01-27T13:32:54.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.031+0000 7f342dd9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3430154d60 0x7f3430153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.031+0000 7f342e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180047c0 0x7f343014f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49878/0 (socket says 172.21.15.46:49878) 2024-01-27T13:32:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.031+0000 7f342e59c640 1 -- 172.21.15.46:0/114459249 learned_addr learned my addr 172.21.15.46:0/114459249 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.032+0000 7fe312c90640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe30c0c7090 0x7fe30c14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.032+0000 7fe312c90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7470 0x7fe30c1f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.032+0000 7fe312c90640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.032+0000 7fe312c90640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1597d0 con 0x7fe30c0c7090 2024-01-27T13:32:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.032+0000 7fe312c90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1f3450 con 0x7fe30c0c7470 2024-01-27T13:32:54.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.032+0000 7fe312c90640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1f3730 con 0x7fe30c0c7920 2024-01-27T13:32:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.034+0000 7f342dd9b640 1 -- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f343014c750 msgr2=0x7f343014cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.035+0000 7f342dd9b640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f343014c750 0x7f343014cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.035+0000 7f342dd9b640 1 -- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180047c0 msgr2=0x7f343014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.035+0000 7f342dd9b640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180047c0 0x7f343014f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.035+0000 7f342dd9b640 1 -- 172.21.15.46:0/114459249 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343014d110 con 0x7f3430154d60 2024-01-27T13:32:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.037+0000 7fe31122d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.037+0000 7f342dd9b640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3430154d60 0x7f3430153020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3424031000 tx=0x7f342402e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.038+0000 7fe31122d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:44010/0 (socket says 172.21.15.46:44010) 2024-01-27T13:32:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.038+0000 7fe31122d640 1 -- 172.21.15.46:0/3487857783 learned_addr learned my addr 172.21.15.46:0/3487857783 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:54.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.038+0000 7fe310a2c640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe30c0c7090 0x7fe30c14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.042+0000 7fe310a2c640 1 -- 172.21.15.46:0/3487857783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 msgr2=0x7fe30c149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.042+0000 7fe310a2c640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.042+0000 7fe310a2c640 1 -- 172.21.15.46:0/3487857783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7470 msgr2=0x7fe30c1f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.042+0000 7fe310a2c640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7470 0x7fe30c1f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.042+0000 7fe310a2c640 1 -- 172.21.15.46:0/3487857783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30400bd40 con 0x7fe30c0c7090 2024-01-27T13:32:54.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.045+0000 7fe310a2c640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe30c0c7090 0x7fe30c14b050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c410 tx=0x7fe30000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.048+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424007540 con 0x7f3430154d60 2024-01-27T13:32:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.048+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34240076a0 con 0x7f3430154d60 2024-01-27T13:32:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.049+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343014fd10 con 0x7f3430154d60 2024-01-27T13:32:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.049+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3430152540 con 0x7f3430154d60 2024-01-27T13:32:54.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.049+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342402c970 con 0x7f3430154d60 2024-01-27T13:32:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.050+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000035f0 con 0x7fe30c0c7090 2024-01-27T13:32:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.050+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300003770 con 0x7fe30c0c7090 2024-01-27T13:32:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.050+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300003b60 con 0x7fe30c0c7090 2024-01-27T13:32:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.051+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c1ef710 con 0x7fe30c0c7090 2024-01-27T13:32:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.051+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c1efcd0 con 0x7fe30c0c7090 2024-01-27T13:32:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.051+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3414005290 con 0x7f3430154d60 2024-01-27T13:32:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.052+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c074410 con 0x7fe30c0c7090 2024-01-27T13:32:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.057+0000 7ff44b7f8640 1 Processor -- start 2024-01-27T13:32:54.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.057+0000 7ff44b7f8640 1 -- start start 2024-01-27T13:32:54.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.058+0000 7ff44b7f8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff4441518f0 0x7ff4440c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.058+0000 7ff44b7f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff44406dde0 0x7ff444158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.058+0000 7ff44b7f8640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44406fa40 con 0x7ff4440704e0 2024-01-27T13:32:54.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.058+0000 7ff44b7f8640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44406b560 con 0x7ff4441518f0 2024-01-27T13:32:54.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.058+0000 7ff44b7f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff444070930 con 0x7ff44406dde0 2024-01-27T13:32:54.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.059+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1690155ba0 con 0x7f16900c8580 2024-01-27T13:32:54.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.068+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3424045020 con 0x7f3430154d60 2024-01-27T13:32:54.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.069+0000 7f341effd640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f341006af20 0x7f341006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.069+0000 7f342e59c640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f341006af20 0x7f341006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.070+0000 7f342e59c640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f341006af20 0x7f341006d3e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3420001780 tx=0x7f3420009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.071+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f342407dda0 con 0x7f3430154d60 2024-01-27T13:32:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.078+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe300003cc0 con 0x7fe30c0c7090 2024-01-27T13:32:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.079+0000 7fe3097fa640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe2f006af20 0x7fe2f006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.079+0000 7fe30bfff640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe2f006af20 0x7fe2f006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.079+0000 7fe30bfff640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe2f006af20 0x7fe2f006d3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0c62f0 tx=0x7fe2f8006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.082+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe300057d30 con 0x7fe30c0c7090 2024-01-27T13:32:54.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.082+0000 7ff449594640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff4441518f0 0x7ff4440c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.083+0000 7ff449594640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff4441518f0 0x7ff4440c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49894/0 (socket says 172.21.15.46:49894) 2024-01-27T13:32:54.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.083+0000 7ff449594640 1 -- 172.21.15.46:0/3057808625 learned_addr learned my addr 172.21.15.46:0/3057808625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:54.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.150+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf70074410 con 0x7fbf70153a70 2024-01-27T13:32:54.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.167+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1ab803c070 con 0x7f1ac80c8f00 2024-01-27T13:32:54.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.178+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1ab80781d0 con 0x7f1ac80c8f00 2024-01-27T13:32:54.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.190+0000 7ff449d95640 1 --2- 172.21.15.46:0/3057808625 >> v2:172.21.15.78:3300/0 conn(0x7ff44406dde0 0x7ff444158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.194+0000 7ff449d95640 1 -- 172.21.15.46:0/3057808625 >> v2:172.21.15.46:3300/0 conn(0x7ff4441518f0 msgr2=0x7ff4440c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:54.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.194+0000 7ff449d95640 1 --2- 172.21.15.46:0/3057808625 >> v2:172.21.15.46:3300/0 conn(0x7ff4441518f0 0x7ff4440c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.194+0000 7ff449d95640 1 -- 172.21.15.46:0/3057808625 >> v1:172.21.15.46:6789/0 conn(0x7ff4440704e0 legacy=0x7ff44406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.194+0000 7ff449d95640 1 -- 172.21.15.46:0/3057808625 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44406e880 con 0x7ff44406dde0 2024-01-27T13:32:54.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.198+0000 7ff449d95640 1 --2- 172.21.15.46:0/3057808625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44406dde0 0x7ff444158110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff444071a70 tx=0x7ff43c02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca64cbaa158add server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.199+0000 7f1677fff640 1 -- 172.21.15.46:0/669654831 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f168407b430 con 0x7f16900c8580 2024-01-27T13:32:54.191 INFO:teuthology.orchestra.run.smithi046.stdout:60129542158 2024-01-27T13:32:54.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f167c06aed0 msgr2=0x7f167c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f167c06aed0 0x7f167c06d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1680000f60 tx=0x7f16800079d0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16900c8580 msgr2=0x7f1690155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16900c8580 0x7f1690155ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1684033000 tx=0x7f1684004730 comp rx=0 tx=0).stop 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 shutdown_connections 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f167c06aed0 0x7f167c06d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1690153a50 0x7f1690156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16900c8580 0x7f1690155ef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 --2- 172.21.15.46:0/669654831 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16900c77d0 0x7f16900c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 >> 172.21.15.46:0/669654831 conn(0x7f169006efe0 msgr2=0x7f169006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 shutdown_connections 2024-01-27T13:32:54.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.201+0000 7f1695fe3640 1 -- 172.21.15.46:0/669654831 wait complete. 2024-01-27T13:32:54.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.206+0000 7ff43bfff640 1 -- 172.21.15.46:0/3057808625 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c02cc80 con 0x7ff44406dde0 2024-01-27T13:32:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.207+0000 7ff43bfff640 1 -- 172.21.15.46:0/3057808625 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c02cde0 con 0x7ff44406dde0 2024-01-27T13:32:54.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.207+0000 7ff43bfff640 1 -- 172.21.15.46:0/3057808625 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c034660 con 0x7ff44406dde0 2024-01-27T13:32:54.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 -- 172.21.15.46:0/3057808625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44406dde0 msgr2=0x7ff444158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/3057808625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44406dde0 0x7ff444158110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff444071a70 tx=0x7ff43c02bed0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd23c074410 con 0x7fd23c0c28c0 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 -- 172.21.15.46:0/3057808625 shutdown_connections 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/3057808625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44406dde0 0x7ff444158110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/3057808625 >> v2:172.21.15.46:3300/0 conn(0x7ff4441518f0 0x7ff4440c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 -- 172.21.15.46:0/3057808625 >> 172.21.15.46:0/3057808625 conn(0x7ff4440c8a10 msgr2=0x7ff4440c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 -- 172.21.15.46:0/3057808625 shutdown_connections 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.208+0000 7ff44b7f8640 1 -- 172.21.15.46:0/3057808625 wait complete. 2024-01-27T13:32:54.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 Processor -- start 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 -- start start 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff44406dde0 0x7ff444154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 0x7ff4441f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4441518f0 0x7ff4441f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444152bb0 con 0x7ff44406dde0 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444158bf0 con 0x7ff4440704e0 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.210+0000 7ff44b7f8640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff444153e80 con 0x7ff4441518f0 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.211+0000 7ff448d93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 0x7ff4441f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.211+0000 7ff448d93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 0x7ff4441f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56682/0 (socket says 172.21.15.46:56682) 2024-01-27T13:32:54.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.211+0000 7ff448d93640 1 -- 172.21.15.46:0/2082622564 learned_addr learned my addr 172.21.15.46:0/2082622564 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:54.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.4 2024-01-27T13:32:54.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.214+0000 7ff448d93640 1 -- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4441518f0 msgr2=0x7ff4441f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.214+0000 7ff448d93640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4441518f0 0x7ff4441f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.214+0000 7ff448d93640 1 -- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff44406dde0 msgr2=0x7ff444154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.214+0000 7ff448d93640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff44406dde0 0x7ff444154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.214+0000 7ff448d93640 1 -- 172.21.15.46:0/2082622564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009a70 con 0x7ff4440704e0 2024-01-27T13:32:54.208 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:54.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.220+0000 7ff448d93640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 0x7ff4441f0610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c400 tx=0x7ff43400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.223+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340052d0 con 0x7ff4440704e0 2024-01-27T13:32:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.223+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434005450 con 0x7ff4440704e0 2024-01-27T13:32:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.223+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434007260 con 0x7ff4440704e0 2024-01-27T13:32:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.223+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff444154160 con 0x7ff4440704e0 2024-01-27T13:32:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.224+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff444154720 con 0x7ff4440704e0 2024-01-27T13:32:54.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.224+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff444074410 con 0x7ff4440704e0 2024-01-27T13:32:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.244+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff4340073c0 con 0x7ff4440704e0 2024-01-27T13:32:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.244+0000 7ff439ffb640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42806af50 0x7ff42806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.245+0000 7ff449594640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42806af50 0x7ff42806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:54.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.245+0000 7ff449594640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42806af50 0x7ff42806d410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff440006f40 tx=0x7ff440006e90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:54.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.318+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f342407a0e0 con 0x7f3430154d60 2024-01-27T13:32:54.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.324+0000 7fd2237fe640 1 -- 172.21.15.46:0/361916477 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd22c058440 con 0x7fd23c0c28c0 2024-01-27T13:32:54.316 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-01-27T13:32:54.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd22806af20 msgr2=0x7fd22806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd22806af20 0x7fd22806d3e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0b1cf0 tx=0x7fd230006c10 comp rx=0 tx=0).stop 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 msgr2=0x7fd23c14b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 0x7fd23c14b620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00b440 tx=0x7fd22c00b900 comp rx=0 tx=0).stop 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 shutdown_connections 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd22806af20 0x7fd22806d3e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd23c0c77d0 0x7fd23c1ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd23c0c2ca0 0x7fd23c14bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 --2- 172.21.15.46:0/361916477 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd23c0c28c0 0x7fd23c14b620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 >> 172.21.15.46:0/361916477 conn(0x7fd23c06efe0 msgr2=0x7fd23c150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 shutdown_connections 2024-01-27T13:32:54.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.327+0000 7fd2415e3640 1 -- 172.21.15.46:0/361916477 wait complete. 2024-01-27T13:32:54.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.7 2024-01-27T13:32:54.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.361+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe300054070 con 0x7fe30c0c7090 2024-01-27T13:32:54.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.370+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1ac80c8760 con 0x7f1ac80c8f00 2024-01-27T13:32:54.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.378+0000 7fbf57fff640 1 -- 172.21.15.46:0/679695672 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf68043020 con 0x7fbf70153a70 2024-01-27T13:32:54.370 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbf5c06af20 msgr2=0x7fbf5c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbf5c06af20 0x7fbf5c06d3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009670 tx=0x7fbf60006bf0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 msgr2=0x7fbf700c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 0x7fbf700c6a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbf68036040 tx=0x7fbf68004a40 comp rx=0 tx=0).stop 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 shutdown_connections 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbf5c06af20 0x7fbf5c06d3e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf70153a70 0x7fbf700c6a90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbf7006c910 0x7fbf700c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 --2- 172.21.15.46:0/679695672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf7006c4f0 0x7fbf70155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.380+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 >> 172.21.15.46:0/679695672 conn(0x7fbf7008b600 msgr2=0x7fbf700cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.381+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 shutdown_connections 2024-01-27T13:32:54.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.381+0000 7fbf75e5d640 1 -- 172.21.15.46:0/679695672 wait complete. 2024-01-27T13:32:54.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.3 2024-01-27T13:32:54.386 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:54.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.476+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff434058590 con 0x7ff4440704e0 2024-01-27T13:32:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.486+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ff4340541d0 con 0x7ff4440704e0 2024-01-27T13:32:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.494+0000 7f1ac4ff9640 1 -- 172.21.15.46:0/259318545 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ab807b7f0 con 0x7f1ac80c8f00 2024-01-27T13:32:54.486 INFO:teuthology.orchestra.run.smithi046.stdout:60129542157 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ab406aed0 msgr2=0x7f1ab406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ab406aed0 0x7f1ab406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1abc000f60 tx=0x7f1abc0079d0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 msgr2=0x7f1ac8159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac8159480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8000c00 tx=0x7f1ab8004730 comp rx=0 tx=0).stop 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 shutdown_connections 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1ab406aed0 0x7f1ab406d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1ac80cf550 0x7f1ac81e20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac80c92e0 0x7f1ac81e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 --2- 172.21.15.46:0/259318545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ac80c8f00 0x7f1ac8159480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 >> 172.21.15.46:0/259318545 conn(0x7f1ac808afd0 msgr2=0x7f1ac80ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 shutdown_connections 2024-01-27T13:32:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.496+0000 7f1ace389640 1 -- 172.21.15.46:0/259318545 wait complete. 2024-01-27T13:32:54.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.6 2024-01-27T13:32:54.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.538+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3414005810 con 0x7f3430154d60 2024-01-27T13:32:54.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.544+0000 7f341effd640 1 -- 172.21.15.46:0/114459249 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f342407d700 con 0x7f3430154d60 2024-01-27T13:32:54.536 INFO:teuthology.orchestra.run.smithi046.stdout:55834574861 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f341006af20 msgr2=0x7f341006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f341006af20 0x7f341006d3e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3420001780 tx=0x7f3420009040 comp rx=0 tx=0).stop 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3430154d60 msgr2=0x7f3430153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3430154d60 0x7f3430153020 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3424031000 tx=0x7f342402e070 comp rx=0 tx=0).stop 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 shutdown_connections 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f341006af20 0x7f341006d3e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f343014c750 0x7f343014cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3430154d60 0x7f3430153020 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 --2- 172.21.15.46:0/114459249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34180047c0 0x7f343014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 >> 172.21.15.46:0/114459249 conn(0x7f343006efe0 msgr2=0x7f34301566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 shutdown_connections 2024-01-27T13:32:54.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.547+0000 7f3434961640 1 -- 172.21.15.46:0/114459249 wait complete. 2024-01-27T13:32:54.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574861 for osd.0 2024-01-27T13:32:54.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.563+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe30c06ed20 con 0x7fe30c0c7090 2024-01-27T13:32:54.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.583+0000 7fe3097fa640 1 -- 172.21.15.46:0/3487857783 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe300017030 con 0x7fe30c0c7090 2024-01-27T13:32:54.576 INFO:teuthology.orchestra.run.smithi046.stdout:64424509453 2024-01-27T13:32:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe2f006af20 msgr2=0x7fe2f006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe2f006af20 0x7fe2f006d3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0c62f0 tx=0x7fe2f8006c90 comp rx=0 tx=0).stop 2024-01-27T13:32:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe30c0c7090 msgr2=0x7fe30c14b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe30c0c7090 0x7fe30c14b050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c410 tx=0x7fe30000c810 comp rx=0 tx=0).stop 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 shutdown_connections 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe2f006af20 0x7fe2f006d3e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe30c0c7920 0x7fe30c149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe30c0c7470 0x7fe30c1f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 --2- 172.21.15.46:0/3487857783 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe30c0c7090 0x7fe30c14b050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.585+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 >> 172.21.15.46:0/3487857783 conn(0x7fe30c0c8a10 msgr2=0x7fe30c14ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.586+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 shutdown_connections 2024-01-27T13:32:54.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.586+0000 7fe312c90640 1 -- 172.21.15.46:0/3487857783 wait complete. 2024-01-27T13:32:54.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.1 2024-01-27T13:32:54.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.716+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff4440c5230 con 0x7ff4440704e0 2024-01-27T13:32:54.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.720+0000 7ff439ffb640 1 -- 172.21.15.46:0/2082622564 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff434020070 con 0x7ff4440704e0 2024-01-27T13:32:54.712 INFO:teuthology.orchestra.run.smithi046.stdout:60129542158 2024-01-27T13:32:54.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.721+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42806af50 msgr2=0x7ff42806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.721+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42806af50 0x7ff42806d410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff440006f40 tx=0x7ff440006e90 comp rx=0 tx=0).stop 2024-01-27T13:32:54.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.721+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 msgr2=0x7ff4441f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:54.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.721+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 0x7ff4441f0610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c400 tx=0x7ff43400c8c0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 shutdown_connections 2024-01-27T13:32:54.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42806af50 0x7ff42806d410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff4441518f0 0x7ff4441f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4440704e0 0x7ff4441f0610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 --2- 172.21.15.46:0/2082622564 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff44406dde0 0x7ff444154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 >> 172.21.15.46:0/2082622564 conn(0x7ff4440c8a10 msgr2=0x7ff4440cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 shutdown_connections 2024-01-27T13:32:54.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:54.722+0000 7ff44b7f8640 1 -- 172.21.15.46:0/2082622564 wait complete. 2024-01-27T13:32:54.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542158 for osd.5 2024-01-27T13:32:54.725 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:55.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-27T13:32:55.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.456+0000 7f27cd656640 1 Processor -- start 2024-01-27T13:32:55.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.456+0000 7f27cd656640 1 -- start start 2024-01-27T13:32:55.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.457+0000 7f27cd656640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27c80c9a50 0x7f27c80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.457+0000 7f27cd656640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c80c3f90 con 0x7f27c80cbab0 2024-01-27T13:32:55.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.457+0000 7f27cd656640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c806c060 con 0x7f27c8153a70 2024-01-27T13:32:55.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.457+0000 7f27cd656640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c80c9e70 con 0x7f27c80c9a50 2024-01-27T13:32:55.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.460+0000 7f27bffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27c80c9a50 0x7f27c80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.461+0000 7f27c6ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f27c8153a70 0x7f27c806c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:33470/0 (socket says 172.21.15.46:33470) 2024-01-27T13:32:55.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.461+0000 7f27c6ffd640 1 -- 172.21.15.46:0/2577544461 learned_addr learned my addr 172.21.15.46:0/2577544461 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:55.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.464+0000 7f27bffff640 1 -- 172.21.15.46:0/2577544461 >> v1:172.21.15.78:6789/0 conn(0x7f27c8153a70 legacy=0x7f27c806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.464+0000 7f27bffff640 1 -- 172.21.15.46:0/2577544461 >> v1:172.21.15.46:6789/0 conn(0x7f27c80cbab0 legacy=0x7f27c81641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.464+0000 7f27bffff640 1 -- 172.21.15.46:0/2577544461 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80670d0 con 0x7f27c80c9a50 2024-01-27T13:32:55.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.469+0000 7f27bffff640 1 --2- 172.21.15.46:0/2577544461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80c9a50 0x7f27c80cb570 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27b00097a0 tx=0x7f27b002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37a113188155caf1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27c67fc640 1 -- 172.21.15.46:0/2577544461 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0031830 con 0x7f27c80c9a50 2024-01-27T13:32:55.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27c67fc640 1 -- 172.21.15.46:0/2577544461 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b0031990 con 0x7f27c80c9a50 2024-01-27T13:32:55.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27c67fc640 1 -- 172.21.15.46:0/2577544461 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0031d20 con 0x7f27c80c9a50 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 -- 172.21.15.46:0/2577544461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80c9a50 msgr2=0x7f27c80cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 --2- 172.21.15.46:0/2577544461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80c9a50 0x7f27c80cb570 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f27b00097a0 tx=0x7f27b002b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 -- 172.21.15.46:0/2577544461 shutdown_connections 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 --2- 172.21.15.46:0/2577544461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80c9a50 0x7f27c80cb570 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 -- 172.21.15.46:0/2577544461 >> 172.21.15.46:0/2577544461 conn(0x7f27c808b600 msgr2=0x7f27c80663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 -- 172.21.15.46:0/2577544461 shutdown_connections 2024-01-27T13:32:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.473+0000 7f27cd656640 1 -- 172.21.15.46:0/2577544461 wait complete. 2024-01-27T13:32:55.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.474+0000 7f27cd656640 1 Processor -- start 2024-01-27T13:32:55.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 -- start start 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c80c9a50 0x7f27c81efd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80cbab0 0x7f27c8154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27c8153a70 0x7f27c8155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8157650 con 0x7f27c80c9a50 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c815dae0 con 0x7f27c80cbab0 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.475+0000 7f27cd656640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80ce030 con 0x7f27c8153a70 2024-01-27T13:32:55.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.476+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c80c9a50 0x7f27c81efd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.476+0000 7f27c6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c80c9a50 0x7f27c81efd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49944/0 (socket says 172.21.15.46:49944) 2024-01-27T13:32:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.476+0000 7f27c6ffd640 1 -- 172.21.15.46:0/3418468464 learned_addr learned my addr 172.21.15.46:0/3418468464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.476+0000 7f27bffff640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80cbab0 0x7f27c8154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.476+0000 7f27c77fe640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27c8153a70 0x7f27c8155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.479+0000 7f27bffff640 1 -- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27c8153a70 msgr2=0x7f27c8155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.479+0000 7f27bffff640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27c8153a70 0x7f27c8155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.479+0000 7f27bffff640 1 -- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c80c9a50 msgr2=0x7f27c81efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.479+0000 7f27bffff640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c80c9a50 0x7f27c81efd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.479+0000 7f27bffff640 1 -- 172.21.15.46:0/3418468464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0009400 con 0x7f27c80cbab0 2024-01-27T13:32:55.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.482+0000 7f27bffff640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80cbab0 0x7f27c8154920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27c80cca40 tx=0x7f27b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.486+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b003aaa0 con 0x7f27c80cbab0 2024-01-27T13:32:55.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.486+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b003ac20 con 0x7f27c80cbab0 2024-01-27T13:32:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.486+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b00423f0 con 0x7f27c80cbab0 2024-01-27T13:32:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.486+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c80ce310 con 0x7f27c80cbab0 2024-01-27T13:32:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.486+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c8155620 con 0x7f27c80cbab0 2024-01-27T13:32:55.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.487+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c8067330 con 0x7f27c80cbab0 2024-01-27T13:32:55.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.506+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f27b004b440 con 0x7f27c80cbab0 2024-01-27T13:32:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.507+0000 7f27bf7fe640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f27a806af20 0x7f27a806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.507+0000 7f27c6ffd640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f27a806af20 0x7f27a806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.507+0000 7f27c6ffd640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f27a806af20 0x7f27a806d3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27b8005880 tx=0x7f27b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-27T13:32:55.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-27T13:32:55.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-27T13:32:55.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.616+0000 7f97cdd9e640 1 Processor -- start 2024-01-27T13:32:55.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.616+0000 7f97cdd9e640 1 -- start start 2024-01-27T13:32:55.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.617+0000 7f97cdd9e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 0x7f97c8156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.617+0000 7f97cdd9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97c815a060 0x7f97c80c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.617+0000 7f97cdd9e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c8157460 con 0x7f97c815a4a0 2024-01-27T13:32:55.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.617+0000 7f97cdd9e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c806ed60 con 0x7f97c815a060 2024-01-27T13:32:55.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.617+0000 7f97cdd9e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c806e1e0 con 0x7f97c8159c80 2024-01-27T13:32:55.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.618+0000 7f97c77fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 0x7f97c8156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.618+0000 7f97c77fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 0x7f97c8156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:42904/0 (socket says 172.21.15.46:42904) 2024-01-27T13:32:55.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.618+0000 7f97c77fe640 1 -- 172.21.15.46:0/64261508 learned_addr learned my addr 172.21.15.46:0/64261508 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.620+0000 7f97c77fe640 1 -- 172.21.15.46:0/64261508 >> v2:172.21.15.78:3300/0 conn(0x7f97c815a060 msgr2=0x7f97c80c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.620+0000 7f97c77fe640 1 --2- 172.21.15.46:0/64261508 >> v2:172.21.15.78:3300/0 conn(0x7f97c815a060 0x7f97c80c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.620+0000 7f97c77fe640 1 -- 172.21.15.46:0/64261508 >> v1:172.21.15.46:6789/0 conn(0x7f97c815a4a0 legacy=0x7f97c8150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:55.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.620+0000 7f97c77fe640 1 -- 172.21.15.46:0/64261508 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c806e4c0 con 0x7f97c8159c80 2024-01-27T13:32:55.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.622+0000 7f97c77fe640 1 --2- 172.21.15.46:0/64261508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 0x7f97c8156f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009870 tx=0x7f97b802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c7dface73ef8b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.626+0000 7f97c67fc640 1 -- 172.21.15.46:0/64261508 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8031640 con 0x7f97c8159c80 2024-01-27T13:32:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.626+0000 7f97c67fc640 1 -- 172.21.15.46:0/64261508 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b80317a0 con 0x7f97c8159c80 2024-01-27T13:32:55.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.626+0000 7f97c67fc640 1 -- 172.21.15.46:0/64261508 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8031b30 con 0x7f97c8159c80 2024-01-27T13:32:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 -- 172.21.15.46:0/64261508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 msgr2=0x7f97c8156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/64261508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 0x7f97c8156f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009870 tx=0x7f97b802b8f0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 -- 172.21.15.46:0/64261508 shutdown_connections 2024-01-27T13:32:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/64261508 >> v2:172.21.15.78:3300/0 conn(0x7f97c815a060 0x7f97c80c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/64261508 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c8159c80 0x7f97c8156f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 -- 172.21.15.46:0/64261508 >> 172.21.15.46:0/64261508 conn(0x7f97c80c89a0 msgr2=0x7f97c80c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:55.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 -- 172.21.15.46:0/64261508 shutdown_connections 2024-01-27T13:32:55.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.627+0000 7f97cdd9e640 1 -- 172.21.15.46:0/64261508 wait complete. 2024-01-27T13:32:55.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.628+0000 7f97cdd9e640 1 Processor -- start 2024-01-27T13:32:55.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 -- start start 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c8159c80 0x7f97c80caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97c815a060 0x7f97c8158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c815a4a0 0x7f97c81497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8159870 con 0x7f97c815a060 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8159590 con 0x7f97c8159c80 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.629+0000 7f97cdd9e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c80c4110 con 0x7f97c815a4a0 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.630+0000 7f97c6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97c815a060 0x7f97c8158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.630+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c815a4a0 0x7f97c81497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.630+0000 7f97c6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97c815a060 0x7f97c8158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49946/0 (socket says 172.21.15.46:49946) 2024-01-27T13:32:55.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.630+0000 7f97c6ffd640 1 -- 172.21.15.46:0/1886788151 learned_addr learned my addr 172.21.15.46:0/1886788151 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.633+0000 7f97c7fff640 1 -- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c8159c80 msgr2=0x7f97c80caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.633+0000 7f97c7fff640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c8159c80 0x7f97c80caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.633+0000 7f97c7fff640 1 -- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97c815a060 msgr2=0x7f97c8158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.633+0000 7f97c7fff640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97c815a060 0x7f97c8158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.633+0000 7f97c7fff640 1 -- 172.21.15.46:0/1886788151 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80094d0 con 0x7f97c815a4a0 2024-01-27T13:32:55.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.635+0000 7f97c7fff640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c815a4a0 0x7f97c81497b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c780 tx=0x7f97c000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.639+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0003b70 con 0x7f97c815a4a0 2024-01-27T13:32:55.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.639+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c0003cf0 con 0x7f97c815a4a0 2024-01-27T13:32:55.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.639+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c0003ea0 con 0x7f97c815a4a0 2024-01-27T13:32:55.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.639+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c80c43f0 con 0x7f97c815a4a0 2024-01-27T13:32:55.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.639+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c80c5ab0 con 0x7f97c815a4a0 2024-01-27T13:32:55.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.640+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c8074410 con 0x7f97c815a4a0 2024-01-27T13:32:55.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.660+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f97c00052b0 con 0x7f97c815a4a0 2024-01-27T13:32:55.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.660+0000 7f97affff640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f97b406af20 0x7f97b406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.660+0000 7f97c77fe640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f97b406af20 0x7f97b406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.661+0000 7f97c77fe640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f97b406af20 0x7f97b406d3e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f97b8036000 tx=0x7f97b8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.672+0000 7fed8832c640 1 Processor -- start 2024-01-27T13:32:55.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.672+0000 7fed8832c640 1 -- start start 2024-01-27T13:32:55.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.672+0000 7fed8832c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed80153a50 0x7fed800c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed8832c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed80159950 0x7fed80159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed8832c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8015a300 con 0x7fed800c77d0 2024-01-27T13:32:55.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed8832c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed800c9740 con 0x7fed80153a50 2024-01-27T13:32:55.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed8832c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed800c9480 con 0x7fed80159950 2024-01-27T13:32:55.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed860c8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed80153a50 0x7fed800c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed860c8640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed80153a50 0x7fed800c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49962/0 (socket says 172.21.15.46:49962) 2024-01-27T13:32:55.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.673+0000 7fed860c8640 1 -- 172.21.15.46:0/3991106332 learned_addr learned my addr 172.21.15.46:0/3991106332 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.676+0000 7fed860c8640 1 -- 172.21.15.46:0/3991106332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed80159950 msgr2=0x7fed80159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:55.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.676+0000 7fed860c8640 1 --2- 172.21.15.46:0/3991106332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed80159950 0x7fed80159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.676+0000 7fed860c8640 1 -- 172.21.15.46:0/3991106332 >> v1:172.21.15.78:6789/0 conn(0x7fed800c77d0 legacy=0x7fed800c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:55.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.676+0000 7fed860c8640 1 -- 172.21.15.46:0/3991106332 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8006bfb0 con 0x7fed80153a50 2024-01-27T13:32:55.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.678+0000 7fed860c8640 1 --2- 172.21.15.46:0/3991106332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80153a50 0x7fed800c8b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009870 tx=0x7fed7c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81a1b5e93911571 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.681+0000 7fed850c6640 1 -- 172.21.15.46:0/3991106332 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c030840 con 0x7fed80153a50 2024-01-27T13:32:55.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.681+0000 7fed850c6640 1 -- 172.21.15.46:0/3991106332 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c0309a0 con 0x7fed80153a50 2024-01-27T13:32:55.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.681+0000 7fed850c6640 1 -- 172.21.15.46:0/3991106332 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c030d30 con 0x7fed80153a50 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 -- 172.21.15.46:0/3991106332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80153a50 msgr2=0x7fed800c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 --2- 172.21.15.46:0/3991106332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80153a50 0x7fed800c8b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009870 tx=0x7fed7c02b980 comp rx=0 tx=0).stop 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 -- 172.21.15.46:0/3991106332 shutdown_connections 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 --2- 172.21.15.46:0/3991106332 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed80159950 0x7fed80159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 --2- 172.21.15.46:0/3991106332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80153a50 0x7fed800c8b80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 -- 172.21.15.46:0/3991106332 >> 172.21.15.46:0/3991106332 conn(0x7fed8006efe0 msgr2=0x7fed8006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 -- 172.21.15.46:0/3991106332 shutdown_connections 2024-01-27T13:32:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.682+0000 7fed8832c640 1 -- 172.21.15.46:0/3991106332 wait complete. 2024-01-27T13:32:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.684+0000 7fed8832c640 1 Processor -- start 2024-01-27T13:32:55.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.684+0000 7fed8832c640 1 -- start start 2024-01-27T13:32:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed8832c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed800c77d0 0x7fed800c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed8832c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed80153a50 0x7fed801582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed8832c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 0x7fed800c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed8832c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800c4840 con 0x7fed80159950 2024-01-27T13:32:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed8832c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed800cdc00 con 0x7fed80153a50 2024-01-27T13:32:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed8832c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed801ef5d0 con 0x7fed800c77d0 2024-01-27T13:32:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed868c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 0x7fed800c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed868c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 0x7fed800c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49972/0 (socket says 172.21.15.46:49972) 2024-01-27T13:32:55.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.685+0000 7fed868c9640 1 -- 172.21.15.46:0/3374593225 learned_addr learned my addr 172.21.15.46:0/3374593225 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.689+0000 7fed868c9640 1 -- 172.21.15.46:0/3374593225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed800c77d0 msgr2=0x7fed800c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.689+0000 7fed868c9640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed800c77d0 0x7fed800c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.689+0000 7fed868c9640 1 -- 172.21.15.46:0/3374593225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed80153a50 msgr2=0x7fed801582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.689+0000 7fed868c9640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed80153a50 0x7fed801582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.689+0000 7fed868c9640 1 -- 172.21.15.46:0/3374593225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c0094d0 con 0x7fed80159950 2024-01-27T13:32:55.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.691+0000 7fed868c9640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 0x7fed800c6e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed7800b970 tx=0x7fed7800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.695+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7800cb40 con 0x7fed80159950 2024-01-27T13:32:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.695+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7800ccc0 con 0x7fed80159950 2024-01-27T13:32:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.695+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed78014680 con 0x7fed80159950 2024-01-27T13:32:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.695+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed800cd0a0 con 0x7fed80159950 2024-01-27T13:32:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.695+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed800cd640 con 0x7fed80159950 2024-01-27T13:32:55.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.696+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8006bd70 con 0x7fed80159950 2024-01-27T13:32:55.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.714+0000 7fed34943640 1 Processor -- start 2024-01-27T13:32:55.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.714+0000 7fed34943640 1 -- start start 2024-01-27T13:32:55.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.715+0000 7fed34943640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fed300c2ca0 0x7fed301514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.715+0000 7fed34943640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed300c77d0 0x7fed30151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.715+0000 7fed34943640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed300ccf60 con 0x7fed300c28c0 2024-01-27T13:32:55.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.715+0000 7fed34943640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed300ca800 con 0x7fed300c2ca0 2024-01-27T13:32:55.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.715+0000 7fed34943640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed301576d0 con 0x7fed300c77d0 2024-01-27T13:32:55.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.750+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27b007a3f0 con 0x7f27c80cbab0 2024-01-27T13:32:55.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.761+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f27b0076730 con 0x7f27c80cbab0 2024-01-27T13:32:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.764+0000 7fed2ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed300c77d0 0x7fed30151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.764+0000 7fed2ed9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed300c77d0 0x7fed30151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:42468/0 (socket says 172.21.15.46:42468) 2024-01-27T13:32:55.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.764+0000 7fed2ed9d640 1 -- 172.21.15.46:0/4216223809 learned_addr learned my addr 172.21.15.46:0/4216223809 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.769+0000 7fed2ed9d640 1 -- 172.21.15.46:0/4216223809 >> v2:172.21.15.46:3300/0 conn(0x7fed300c2ca0 msgr2=0x7fed301514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:55.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.769+0000 7fed2ed9d640 1 --2- 172.21.15.46:0/4216223809 >> v2:172.21.15.46:3300/0 conn(0x7fed300c2ca0 0x7fed301514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.769+0000 7fed2ed9d640 1 -- 172.21.15.46:0/4216223809 >> v1:172.21.15.46:6789/0 conn(0x7fed300c28c0 legacy=0x7fed300c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:55.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.769+0000 7fed2ed9d640 1 -- 172.21.15.46:0/4216223809 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300cd200 con 0x7fed300c77d0 2024-01-27T13:32:55.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.771+0000 7fed2ed9d640 1 --2- 172.21.15.46:0/4216223809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c77d0 0x7fed30151a30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2002b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f991a925b0f063 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.775+0000 7fed2d59a640 1 -- 172.21.15.46:0/4216223809 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20031890 con 0x7fed300c77d0 2024-01-27T13:32:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.775+0000 7fed2d59a640 1 -- 172.21.15.46:0/4216223809 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed200319f0 con 0x7fed300c77d0 2024-01-27T13:32:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.775+0000 7fed2d59a640 1 -- 172.21.15.46:0/4216223809 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20031d80 con 0x7fed300c77d0 2024-01-27T13:32:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 -- 172.21.15.46:0/4216223809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c77d0 msgr2=0x7fed30151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 --2- 172.21.15.46:0/4216223809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c77d0 0x7fed30151a30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed20009870 tx=0x7fed2002b930 comp rx=0 tx=0).stop 2024-01-27T13:32:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 -- 172.21.15.46:0/4216223809 shutdown_connections 2024-01-27T13:32:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 --2- 172.21.15.46:0/4216223809 >> v2:172.21.15.46:3300/0 conn(0x7fed300c2ca0 0x7fed301514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 --2- 172.21.15.46:0/4216223809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c77d0 0x7fed30151a30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 -- 172.21.15.46:0/4216223809 >> 172.21.15.46:0/4216223809 conn(0x7fed3006efe0 msgr2=0x7fed3006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 -- 172.21.15.46:0/4216223809 shutdown_connections 2024-01-27T13:32:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.776+0000 7fed34943640 1 -- 172.21.15.46:0/4216223809 wait complete. 2024-01-27T13:32:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.777+0000 7fed34943640 1 Processor -- start 2024-01-27T13:32:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.777+0000 7fed34943640 1 -- start start 2024-01-27T13:32:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed34943640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 0x7fed30154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed34943640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed300c2ca0 0x7fed3014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed34943640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed300c77d0 0x7fed301f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed34943640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301e1430 con 0x7fed300c77d0 2024-01-27T13:32:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed34943640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301f0780 con 0x7fed300c28c0 2024-01-27T13:32:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed34943640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed30154dc0 con 0x7fed300c2ca0 2024-01-27T13:32:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.778+0000 7fed2e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 0x7fed30154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.779+0000 7fed2e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 0x7fed30154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:42474/0 (socket says 172.21.15.46:42474) 2024-01-27T13:32:55.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.779+0000 7fed2e59c640 1 -- 172.21.15.46:0/3238550547 learned_addr learned my addr 172.21.15.46:0/3238550547 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.782+0000 7fed2e59c640 1 -- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed300c2ca0 msgr2=0x7fed3014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.782+0000 7fed2e59c640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed300c2ca0 0x7fed3014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.782+0000 7fed2e59c640 1 -- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed300c77d0 msgr2=0x7fed301f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.782+0000 7fed2e59c640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed300c77d0 0x7fed301f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:55.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.782+0000 7fed2e59c640 1 -- 172.21.15.46:0/3238550547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200094d0 con 0x7fed300c28c0 2024-01-27T13:32:55.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.785+0000 7fed2e59c640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 0x7fed30154880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c7d0 tx=0x7fed2800cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:55.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.787+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28003d80 con 0x7fed300c28c0 2024-01-27T13:32:55.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.787+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3014fae0 con 0x7fed300c28c0 2024-01-27T13:32:55.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.787+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3014f520 con 0x7fed300c28c0 2024-01-27T13:32:55.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.788+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed28005070 con 0x7fed300c28c0 2024-01-27T13:32:55.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.788+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed280053e0 con 0x7fed300c28c0 2024-01-27T13:32:55.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.789+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed30074410 con 0x7fed300c28c0 2024-01-27T13:32:55.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.897+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f97c0013e70 con 0x7f97c815a4a0 2024-01-27T13:32:55.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.914+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f97c0054230 con 0x7f97c815a4a0 2024-01-27T13:32:55.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.972+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f27c80ca8d0 con 0x7f27c80cbab0 2024-01-27T13:32:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.987+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fed7801d3b0 con 0x7fed80159950 2024-01-27T13:32:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.988+0000 7fed76ffd640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed6406af20 0x7fed6406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.988+0000 7fed860c8640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed6406af20 0x7fed6406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:55.988+0000 7fed860c8640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed6406af20 0x7fed6406d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed7c036000 tx=0x7fed7c03b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:56.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.014+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed7800ce30 con 0x7fed80159950 2024-01-27T13:32:56.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.014+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fed78054930 con 0x7fed80159950 2024-01-27T13:32:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.043+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fed28005540 con 0x7fed300c28c0 2024-01-27T13:32:56.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.043+0000 7fed1effd640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed1006aed0 0x7fed1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.043+0000 7fed2dd9b640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed1006aed0 0x7fed1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.044+0000 7fed2dd9b640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed1006aed0 0x7fed1006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed3014e130 tx=0x7fed24006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:56.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.047+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fed28058070 con 0x7fed300c28c0 2024-01-27T13:32:56.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.057+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fed280543b0 con 0x7fed300c28c0 2024-01-27T13:32:56.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.064+0000 7f27bf7fe640 1 -- 172.21.15.46:0/3418468464 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27b0035020 con 0x7f27c80cbab0 2024-01-27T13:32:56.056 INFO:teuthology.orchestra.run.smithi046.stdout:60129542159 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f27a806af20 msgr2=0x7f27a806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f27a806af20 0x7f27a806d3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27b8005880 tx=0x7f27b8009040 comp rx=0 tx=0).stop 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80cbab0 msgr2=0x7f27c8154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80cbab0 0x7f27c8154920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f27c80cca40 tx=0x7f27b00046c0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 shutdown_connections 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f27a806af20 0x7f27a806d3e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27c8153a70 0x7f27c8155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27c80cbab0 0x7f27c8154920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 --2- 172.21.15.46:0/3418468464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27c80c9a50 0x7f27c81efd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.066+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 >> 172.21.15.46:0/3418468464 conn(0x7f27c808b600 msgr2=0x7f27c81507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.067+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 shutdown_connections 2024-01-27T13:32:56.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.067+0000 7f27cd656640 1 -- 172.21.15.46:0/3418468464 wait complete. 2024-01-27T13:32:56.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542159 for osd.7 2024-01-27T13:32:56.070 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:56.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.159+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f97c80c4250 con 0x7f97c815a4a0 2024-01-27T13:32:56.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.163+0000 7f97affff640 1 -- 172.21.15.46:0/1886788151 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97c80c4250 con 0x7f97c815a4a0 2024-01-27T13:32:56.155 INFO:teuthology.orchestra.run.smithi046.stdout:60129542159 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.165+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f97b406af20 msgr2=0x7f97b406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.165+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f97b406af20 0x7f97b406d3e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f97b8036000 tx=0x7f97b8030000 comp rx=0 tx=0).stop 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c815a4a0 msgr2=0x7f97c81497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c815a4a0 0x7f97c81497b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c780 tx=0x7f97c000cc40 comp rx=0 tx=0).stop 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 shutdown_connections 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f97b406af20 0x7f97b406d3e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f97c815a4a0 0x7f97c81497b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97c815a060 0x7f97c8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 --2- 172.21.15.46:0/1886788151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c8159c80 0x7f97c80caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 >> 172.21.15.46:0/1886788151 conn(0x7f97c80c89a0 msgr2=0x7f97c814f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 shutdown_connections 2024-01-27T13:32:56.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.166+0000 7f97cdd9e640 1 -- 172.21.15.46:0/1886788151 wait complete. 2024-01-27T13:32:56.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542159 for osd.6 2024-01-27T13:32:56.169 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:56.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.203+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fed80074410 con 0x7fed80159950 2024-01-27T13:32:56.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.208+0000 7fed76ffd640 1 -- 172.21.15.46:0/3374593225 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed78019070 con 0x7fed80159950 2024-01-27T13:32:56.200 INFO:teuthology.orchestra.run.smithi046.stdout:55834574863 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed6406af20 msgr2=0x7fed6406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed6406af20 0x7fed6406d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed7c036000 tx=0x7fed7c03b040 comp rx=0 tx=0).stop 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 msgr2=0x7fed800c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 0x7fed800c6e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed7800b970 tx=0x7fed7800be30 comp rx=0 tx=0).stop 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 shutdown_connections 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed6406af20 0x7fed6406d3e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed80159950 0x7fed800c6e20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed80153a50 0x7fed801582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 --2- 172.21.15.46:0/3374593225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed800c77d0 0x7fed800c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 >> 172.21.15.46:0/3374593225 conn(0x7fed8006efe0 msgr2=0x7fed80151910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 shutdown_connections 2024-01-27T13:32:56.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.210+0000 7fed8832c640 1 -- 172.21.15.46:0/3374593225 wait complete. 2024-01-27T13:32:56.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574863 for osd.0 2024-01-27T13:32:56.213 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:56.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.263+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed300c8fa0 con 0x7fed300c28c0 2024-01-27T13:32:56.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.267+0000 7fed1effd640 1 -- 172.21.15.46:0/3238550547 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed28021020 con 0x7fed300c28c0 2024-01-27T13:32:56.259 INFO:teuthology.orchestra.run.smithi046.stdout:64424509454 2024-01-27T13:32:56.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed1006aed0 msgr2=0x7fed1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed1006aed0 0x7fed1006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed3014e130 tx=0x7fed24006c90 comp rx=0 tx=0).stop 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 msgr2=0x7fed30154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 0x7fed30154880 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fed2800c7d0 tx=0x7fed2800cc90 comp rx=0 tx=0).stop 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 shutdown_connections 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fed1006aed0 0x7fed1006d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed300c77d0 0x7fed301f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fed300c2ca0 0x7fed3014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 --2- 172.21.15.46:0/3238550547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed300c28c0 0x7fed30154880 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 >> 172.21.15.46:0/3238550547 conn(0x7fed3006efe0 msgr2=0x7fed300c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:56.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 shutdown_connections 2024-01-27T13:32:56.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.269+0000 7fed34943640 1 -- 172.21.15.46:0/3238550547 wait complete. 2024-01-27T13:32:56.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.1 2024-01-27T13:32:56.273 DEBUG:teuthology.parallel:result is None 2024-01-27T13:32:56.273 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-27T13:32:56.273 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T13:32:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 Processor -- start 2024-01-27T13:32:56.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 -- start start 2024-01-27T13:32:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fbe300c2ca0 0x7fbe301514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300ccf60 con 0x7fbe300c28c0 2024-01-27T13:32:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300ca800 con 0x7fbe300c2ca0 2024-01-27T13:32:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.382+0000 7fbe374ee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe301576d0 con 0x7fbe300c77d0 2024-01-27T13:32:56.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.383+0000 7fbe3528a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbe300c28c0 0x7fbe300c1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47078/0 (socket says 172.21.15.46:47078) 2024-01-27T13:32:56.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.383+0000 7fbe3528a640 1 -- 172.21.15.46:0/897895789 learned_addr learned my addr 172.21.15.46:0/897895789 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:56.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.383+0000 7fbe34a89640 1 --2- 172.21.15.46:0/897895789 >> v2:172.21.15.46:3300/0 conn(0x7fbe300c2ca0 0x7fbe301514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.385+0000 7fbe35a8b640 1 --2- 172.21.15.46:0/897895789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.388+0000 7fbe35a8b640 1 -- 172.21.15.46:0/897895789 >> v2:172.21.15.46:3300/0 conn(0x7fbe300c2ca0 msgr2=0x7fbe301514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:56.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.388+0000 7fbe35a8b640 1 --2- 172.21.15.46:0/897895789 >> v2:172.21.15.46:3300/0 conn(0x7fbe300c2ca0 0x7fbe301514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.388+0000 7fbe35a8b640 1 -- 172.21.15.46:0/897895789 >> v1:172.21.15.46:6789/0 conn(0x7fbe300c28c0 legacy=0x7fbe300c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.388+0000 7fbe35a8b640 1 -- 172.21.15.46:0/897895789 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300cd200 con 0x7fbe300c77d0 2024-01-27T13:32:56.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.390+0000 7fbe35a8b640 1 --2- 172.21.15.46:0/897895789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30151a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009d90 tx=0x7fbe2802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61c3dae77bdde1d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:56.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.394+0000 7fbe27fff640 1 -- 172.21.15.46:0/897895789 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2802cc50 con 0x7fbe300c77d0 2024-01-27T13:32:56.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.394+0000 7fbe27fff640 1 -- 172.21.15.46:0/897895789 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2802cdb0 con 0x7fbe300c77d0 2024-01-27T13:32:56.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.394+0000 7fbe27fff640 1 -- 172.21.15.46:0/897895789 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28034660 con 0x7fbe300c77d0 2024-01-27T13:32:56.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 -- 172.21.15.46:0/897895789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 msgr2=0x7fbe30151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 --2- 172.21.15.46:0/897895789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30151a30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009d90 tx=0x7fbe2802bea0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 -- 172.21.15.46:0/897895789 shutdown_connections 2024-01-27T13:32:56.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 --2- 172.21.15.46:0/897895789 >> v2:172.21.15.46:3300/0 conn(0x7fbe300c2ca0 0x7fbe301514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 --2- 172.21.15.46:0/897895789 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30151a30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 -- 172.21.15.46:0/897895789 >> 172.21.15.46:0/897895789 conn(0x7fbe3006efe0 msgr2=0x7fbe3006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:56.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 -- 172.21.15.46:0/897895789 shutdown_connections 2024-01-27T13:32:56.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.395+0000 7fbe374ee640 1 -- 172.21.15.46:0/897895789 wait complete. 2024-01-27T13:32:56.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.397+0000 7fbe374ee640 1 Processor -- start 2024-01-27T13:32:56.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.397+0000 7fbe374ee640 1 -- start start 2024-01-27T13:32:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe374ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe300c28c0 0x7fbe300c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe374ee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe300c2ca0 0x7fbe301f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe374ee640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe374ee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014abb0 con 0x7fbe300c2ca0 2024-01-27T13:32:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe374ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014a5d0 con 0x7fbe300c28c0 2024-01-27T13:32:56.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe374ee640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3006d120 con 0x7fbe300c77d0 2024-01-27T13:32:56.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe35a8b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.398+0000 7fbe3528a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe300c28c0 0x7fbe300c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.399+0000 7fbe35a8b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30148880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:42948/0 (socket says 172.21.15.46:42948) 2024-01-27T13:32:56.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.399+0000 7fbe35a8b640 1 -- 172.21.15.46:0/1421371389 learned_addr learned my addr 172.21.15.46:0/1421371389 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:56.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.400+0000 7fbe34a89640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe300c2ca0 0x7fbe301f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.402+0000 7fbe3528a640 1 -- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 msgr2=0x7fbe30148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.402+0000 7fbe3528a640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.402+0000 7fbe3528a640 1 -- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe300c2ca0 msgr2=0x7fbe301f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.402+0000 7fbe3528a640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe300c2ca0 0x7fbe301f2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.402+0000 7fbe3528a640 1 -- 172.21.15.46:0/1421371389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe28009a70 con 0x7fbe300c28c0 2024-01-27T13:32:56.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.404+0000 7fbe3528a640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe300c28c0 0x7fbe300c8c80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c000f60 tx=0x7fbe2c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:56.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.409+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c005ce0 con 0x7fbe300c28c0 2024-01-27T13:32:56.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.409+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c005e40 con 0x7fbe300c28c0 2024-01-27T13:32:56.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.409+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c007310 con 0x7fbe300c28c0 2024-01-27T13:32:56.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.409+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3006d400 con 0x7fbe300c28c0 2024-01-27T13:32:56.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.410+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3014a840 con 0x7fbe300c28c0 2024-01-27T13:32:56.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.411+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe30074410 con 0x7fbe300c28c0 2024-01-27T13:32:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.657+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbe2c007470 con 0x7fbe300c28c0 2024-01-27T13:32:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.657+0000 7fbe25ffb640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbe1406af50 0x7fbe1406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:56.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.658+0000 7fbe34a89640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbe1406af50 0x7fbe1406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:56.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.658+0000 7fbe34a89640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbe1406af50 0x7fbe1406d410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe301ed3b0 tx=0x7fbe20009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:56.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.661+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe2c013e70 con 0x7fbe300c28c0 2024-01-27T13:32:56.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.672+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbe2c053ec0 con 0x7fbe300c28c0 2024-01-27T13:32:56.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.852+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe300cdaa0 con 0x7fbe1406af50 2024-01-27T13:32:56.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.861+0000 7fbe25ffb640 1 -- 172.21.15.46:0/1421371389 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345409 (secure 0 0 0) 0x7fbe20011a30 con 0x7fbe1406af50 2024-01-27T13:32:56.857 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:56.859 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T13:32:56.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.864+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbe1406af50 msgr2=0x7fbe1406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.864+0000 7fbe374ee640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbe1406af50 0x7fbe1406d410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbe301ed3b0 tx=0x7fbe20009190 comp rx=0 tx=0).stop 2024-01-27T13:32:56.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.864+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe300c28c0 msgr2=0x7fbe300c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:56.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.864+0000 7fbe374ee640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe300c28c0 0x7fbe300c8c80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c000f60 tx=0x7fbe2c00c800 comp rx=0 tx=0).stop 2024-01-27T13:32:56.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 shutdown_connections 2024-01-27T13:32:56.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbe1406af50 0x7fbe1406d410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbe300c77d0 0x7fbe30148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe300c2ca0 0x7fbe301f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 --2- 172.21.15.46:0/1421371389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe300c28c0 0x7fbe300c8c80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:56.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 >> 172.21.15.46:0/1421371389 conn(0x7fbe3006efe0 msgr2=0x7fbe3006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:56.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 shutdown_connections 2024-01-27T13:32:56.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:56.865+0000 7fbe374ee640 1 -- 172.21.15.46:0/1421371389 wait complete. 2024-01-27T13:32:56.868 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-01-27T13:32:55.585412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":320,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235216,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739504,"statfs":{"total":773094113280,"available":772853252096,"internally_reserved":0,"allocated":2457600,"data_stored":2120206,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001986"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669809+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:32:51.669809+0000","last_peered":"2024-01-27T13:32:51.669809+0000","last_clean":"2024-01-27T13:32:51.669809+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:32:51.669809+0000","last_undegraded":"2024-01-27T13:32:51.669809+0000","last_fullsized":"2024-01-27T13:32:51.669809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670362+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T13:32:51.670362+0000","last_peered":"2024-01-27T13:32:51.670362+0000","last_clean":"2024-01-27T13:32:51.670362+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T13:32:51.670362+0000","last_undegraded":"2024-01-27T13:32:51.670362+0000","last_fullsized":"2024-01-27T13:32:51.670362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669450+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:32:51.669450+0000","last_peered":"2024-01-27T13:32:51.669450+0000","last_clean":"2024-01-27T13:32:51.669450+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:32:51.669450+0000","last_undegraded":"2024-01-27T13:32:51.669450+0000","last_fullsized":"2024-01-27T13:32:51.669450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670515+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:32:51.670515+0000","last_peered":"2024-01-27T13:32:51.670515+0000","last_clean":"2024-01-27T13:32:51.670515+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:32:51.670515+0000","last_undegraded":"2024-01-27T13:32:51.670515+0000","last_fullsized":"2024-01-27T13:32:51.670515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669567+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T13:32:51.669567+0000","last_peered":"2024-01-27T13:32:51.669567+0000","last_clean":"2024-01-27T13:32:51.669567+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T13:32:51.669567+0000","last_undegraded":"2024-01-27T13:32:51.669567+0000","last_fullsized":"2024-01-27T13:32:51.669567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666379+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:32:51.666379+0000","last_peered":"2024-01-27T13:32:51.666379+0000","last_clean":"2024-01-27T13:32:51.666379+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:32:51.666379+0000","last_undegraded":"2024-01-27T13:32:51.666379+0000","last_fullsized":"2024-01-27T13:32:51.666379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659943+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:32:51.659943+0000","last_peered":"2024-01-27T13:32:51.659943+0000","last_clean":"2024-01-27T13:32:51.659943+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:32:51.659943+0000","last_undegraded":"2024-01-27T13:32:51.659943+0000","last_fullsized":"2024-01-27T13:32:51.659943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705424+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T13:32:51.705424+0000","last_peered":"2024-01-27T13:32:51.705424+0000","last_clean":"2024-01-27T13:32:51.705424+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T13:32:51.705424+0000","last_undegraded":"2024-01-27T13:32:51.705424+0000","last_fullsized":"2024-01-27T13:32:51.705424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666712+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:32:51.666712+0000","last_peered":"2024-01-27T13:32:51.666712+0000","last_clean":"2024-01-27T13:32:51.666712+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:32:51.666712+0000","last_undegraded":"2024-01-27T13:32:51.666712+0000","last_fullsized":"2024-01-27T13:32:51.666712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659644+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:32:51.659644+0000","last_peered":"2024-01-27T13:32:51.659644+0000","last_clean":"2024-01-27T13:32:51.659644+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:32:51.659644+0000","last_undegraded":"2024-01-27T13:32:51.659644+0000","last_fullsized":"2024-01-27T13:32:51.659644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705649+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T13:32:51.705649+0000","last_peered":"2024-01-27T13:32:51.705649+0000","last_clean":"2024-01-27T13:32:51.705649+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T13:32:51.705649+0000","last_undegraded":"2024-01-27T13:32:51.705649+0000","last_fullsized":"2024-01-27T13:32:51.705649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666638+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:32:51.666638+0000","last_peered":"2024-01-27T13:32:51.666638+0000","last_clean":"2024-01-27T13:32:51.666638+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:32:51.666638+0000","last_undegraded":"2024-01-27T13:32:51.666638+0000","last_fullsized":"2024-01-27T13:32:51.666638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672649+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T13:32:51.672649+0000","last_peered":"2024-01-27T13:32:51.672649+0000","last_clean":"2024-01-27T13:32:51.672649+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T13:32:51.672649+0000","last_undegraded":"2024-01-27T13:32:51.672649+0000","last_fullsized":"2024-01-27T13:32:51.672649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659760+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:32:51.659760+0000","last_peered":"2024-01-27T13:32:51.659760+0000","last_clean":"2024-01-27T13:32:51.659760+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:32:51.659760+0000","last_undegraded":"2024-01-27T13:32:51.659760+0000","last_fullsized":"2024-01-27T13:32:51.659760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707357+0000","last_change":"2024-01-27T13:32:51.707357+0000","last_active":"2024-01-27T13:32:51.707357+0000","last_peered":"2024-01-27T13:32:51.707357+0000","last_clean":"2024-01-27T13:32:51.707357+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T13:32:51.707357+0000","last_undegraded":"2024-01-27T13:32:51.707357+0000","last_fullsized":"2024-01-27T13:32:51.707357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:36:27.470407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671791+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T13:32:51.671791+0000","last_peered":"2024-01-27T13:32:51.671791+0000","last_clean":"2024-01-27T13:32:51.671791+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T13:32:51.671791+0000","last_undegraded":"2024-01-27T13:32:51.671791+0000","last_fullsized":"2024-01-27T13:32:51.671791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707487+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:32:51.707487+0000","last_peered":"2024-01-27T13:32:51.707487+0000","last_clean":"2024-01-27T13:32:51.707487+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:32:51.707487+0000","last_undegraded":"2024-01-27T13:32:51.707487+0000","last_fullsized":"2024-01-27T13:32:51.707487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666947+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:32:51.666947+0000","last_peered":"2024-01-27T13:32:51.666947+0000","last_clean":"2024-01-27T13:32:51.666947+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:32:51.666947+0000","last_undegraded":"2024-01-27T13:32:51.666947+0000","last_fullsized":"2024-01-27T13:32:51.666947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.715993+0000","last_change":"2024-01-27T13:32:51.715993+0000","last_active":"2024-01-27T13:32:51.715993+0000","last_peered":"2024-01-27T13:32:51.715993+0000","last_clean":"2024-01-27T13:32:51.715993+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T13:32:51.715993+0000","last_undegraded":"2024-01-27T13:32:51.715993+0000","last_fullsized":"2024-01-27T13:32:51.715993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707014+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:32:51.707014+0000","last_peered":"2024-01-27T13:32:51.707014+0000","last_clean":"2024-01-27T13:32:51.707014+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:32:51.707014+0000","last_undegraded":"2024-01-27T13:32:51.707014+0000","last_fullsized":"2024-01-27T13:32:51.707014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708878+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:32:51.708878+0000","last_peered":"2024-01-27T13:32:51.708878+0000","last_clean":"2024-01-27T13:32:51.708878+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:32:51.708878+0000","last_undegraded":"2024-01-27T13:32:51.708878+0000","last_fullsized":"2024-01-27T13:32:51.708878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666736+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:32:51.666736+0000","last_peered":"2024-01-27T13:32:51.666736+0000","last_clean":"2024-01-27T13:32:51.666736+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:32:51.666736+0000","last_undegraded":"2024-01-27T13:32:51.666736+0000","last_fullsized":"2024-01-27T13:32:51.666736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659249+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:32:51.659249+0000","last_peered":"2024-01-27T13:32:51.659249+0000","last_clean":"2024-01-27T13:32:51.659249+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:32:51.659249+0000","last_undegraded":"2024-01-27T13:32:51.659249+0000","last_fullsized":"2024-01-27T13:32:51.659249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667057+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:32:51.667057+0000","last_peered":"2024-01-27T13:32:51.667057+0000","last_clean":"2024-01-27T13:32:51.667057+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:32:51.667057+0000","last_undegraded":"2024-01-27T13:32:51.667057+0000","last_fullsized":"2024-01-27T13:32:51.667057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667927+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T13:32:51.667927+0000","last_peered":"2024-01-27T13:32:51.667927+0000","last_clean":"2024-01-27T13:32:51.667927+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T13:32:51.667927+0000","last_undegraded":"2024-01-27T13:32:51.667927+0000","last_fullsized":"2024-01-27T13:32:51.667927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673327+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:32:51.673327+0000","last_peered":"2024-01-27T13:32:51.673327+0000","last_clean":"2024-01-27T13:32:51.673327+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:32:51.673327+0000","last_undegraded":"2024-01-27T13:32:51.673327+0000","last_fullsized":"2024-01-27T13:32:51.673327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666586+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:32:51.666586+0000","last_peered":"2024-01-27T13:32:51.666586+0000","last_clean":"2024-01-27T13:32:51.666586+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:32:51.666586+0000","last_undegraded":"2024-01-27T13:32:51.666586+0000","last_fullsized":"2024-01-27T13:32:51.666586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671553+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T13:32:51.671553+0000","last_peered":"2024-01-27T13:32:51.671553+0000","last_clean":"2024-01-27T13:32:51.671553+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T13:32:51.671553+0000","last_undegraded":"2024-01-27T13:32:51.671553+0000","last_fullsized":"2024-01-27T13:32:51.671553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708699+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:32:51.708699+0000","last_peered":"2024-01-27T13:32:51.708699+0000","last_clean":"2024-01-27T13:32:51.708699+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:32:51.708699+0000","last_undegraded":"2024-01-27T13:32:51.708699+0000","last_fullsized":"2024-01-27T13:32:51.708699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.674638+0000","last_change":"2024-01-27T13:32:51.674638+0000","last_active":"2024-01-27T13:32:51.674638+0000","last_peered":"2024-01-27T13:32:51.674638+0000","last_clean":"2024-01-27T13:32:51.674638+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T13:32:51.674638+0000","last_undegraded":"2024-01-27T13:32:51.674638+0000","last_fullsized":"2024-01-27T13:32:51.674638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:38.395479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708198+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T13:32:51.708198+0000","last_peered":"2024-01-27T13:32:51.708198+0000","last_clean":"2024-01-27T13:32:51.708198+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T13:32:51.708198+0000","last_undegraded":"2024-01-27T13:32:51.708198+0000","last_fullsized":"2024-01-27T13:32:51.708198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.660034+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:32:51.660034+0000","last_peered":"2024-01-27T13:32:51.660034+0000","last_clean":"2024-01-27T13:32:51.660034+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:32:51.660034+0000","last_undegraded":"2024-01-27T13:32:51.660034+0000","last_fullsized":"2024-01-27T13:32:51.660034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666357+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:32:51.666357+0000","last_peered":"2024-01-27T13:32:51.666357+0000","last_clean":"2024-01-27T13:32:51.666357+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:32:51.666357+0000","last_undegraded":"2024-01-27T13:32:51.666357+0000","last_fullsized":"2024-01-27T13:32:51.666357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705690+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T13:32:51.705690+0000","last_peered":"2024-01-27T13:32:51.705690+0000","last_clean":"2024-01-27T13:32:51.705690+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T13:32:51.705690+0000","last_undegraded":"2024-01-27T13:32:51.705690+0000","last_fullsized":"2024-01-27T13:32:51.705690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708281+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:32:51.708281+0000","last_peered":"2024-01-27T13:32:51.708281+0000","last_clean":"2024-01-27T13:32:51.708281+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:32:51.708281+0000","last_undegraded":"2024-01-27T13:32:51.708281+0000","last_fullsized":"2024-01-27T13:32:51.708281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707114+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:32:51.707114+0000","last_peered":"2024-01-27T13:32:51.707114+0000","last_clean":"2024-01-27T13:32:51.707114+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:32:51.707114+0000","last_undegraded":"2024-01-27T13:32:51.707114+0000","last_fullsized":"2024-01-27T13:32:51.707114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666998+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T13:32:51.666998+0000","last_peered":"2024-01-27T13:32:51.666998+0000","last_clean":"2024-01-27T13:32:51.666998+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T13:32:51.666998+0000","last_undegraded":"2024-01-27T13:32:51.666998+0000","last_fullsized":"2024-01-27T13:32:51.666998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705568+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:32:51.705568+0000","last_peered":"2024-01-27T13:32:51.705568+0000","last_clean":"2024-01-27T13:32:51.705568+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:32:51.705568+0000","last_undegraded":"2024-01-27T13:32:51.705568+0000","last_fullsized":"2024-01-27T13:32:51.705568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708047+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:32:51.708047+0000","last_peered":"2024-01-27T13:32:51.708047+0000","last_clean":"2024-01-27T13:32:51.708047+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:32:51.708047+0000","last_undegraded":"2024-01-27T13:32:51.708047+0000","last_fullsized":"2024-01-27T13:32:51.708047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.712868+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T13:32:51.712868+0000","last_peered":"2024-01-27T13:32:51.712868+0000","last_clean":"2024-01-27T13:32:51.712868+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T13:32:51.712868+0000","last_undegraded":"2024-01-27T13:32:51.712868+0000","last_fullsized":"2024-01-27T13:32:51.712868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663265+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T13:32:51.663265+0000","last_peered":"2024-01-27T13:32:51.663265+0000","last_clean":"2024-01-27T13:32:51.663265+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T13:32:51.663265+0000","last_undegraded":"2024-01-27T13:32:51.663265+0000","last_fullsized":"2024-01-27T13:32:51.663265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708976+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:32:51.708976+0000","last_peered":"2024-01-27T13:32:51.708976+0000","last_clean":"2024-01-27T13:32:51.708976+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:32:51.708976+0000","last_undegraded":"2024-01-27T13:32:51.708976+0000","last_fullsized":"2024-01-27T13:32:51.708976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669924+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T13:32:51.669924+0000","last_peered":"2024-01-27T13:32:51.669924+0000","last_clean":"2024-01-27T13:32:51.669924+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T13:32:51.669924+0000","last_undegraded":"2024-01-27T13:32:51.669924+0000","last_fullsized":"2024-01-27T13:32:51.669924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659350+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T13:32:51.659350+0000","last_peered":"2024-01-27T13:32:51.659350+0000","last_clean":"2024-01-27T13:32:51.659350+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T13:32:51.659350+0000","last_undegraded":"2024-01-27T13:32:51.659350+0000","last_fullsized":"2024-01-27T13:32:51.659350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667756+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:32:51.667756+0000","last_peered":"2024-01-27T13:32:51.667756+0000","last_clean":"2024-01-27T13:32:51.667756+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:32:51.667756+0000","last_undegraded":"2024-01-27T13:32:51.667756+0000","last_fullsized":"2024-01-27T13:32:51.667756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670048+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T13:32:51.670048+0000","last_peered":"2024-01-27T13:32:51.670048+0000","last_clean":"2024-01-27T13:32:51.670048+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T13:32:51.670048+0000","last_undegraded":"2024-01-27T13:32:51.670048+0000","last_fullsized":"2024-01-27T13:32:51.670048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705733+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:32:51.705733+0000","last_peered":"2024-01-27T13:32:51.705733+0000","last_clean":"2024-01-27T13:32:51.705733+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:32:51.705733+0000","last_undegraded":"2024-01-27T13:32:51.705733+0000","last_fullsized":"2024-01-27T13:32:51.705733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659354+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:32:51.659354+0000","last_peered":"2024-01-27T13:32:51.659354+0000","last_clean":"2024-01-27T13:32:51.659354+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:32:51.659354+0000","last_undegraded":"2024-01-27T13:32:51.659354+0000","last_fullsized":"2024-01-27T13:32:51.659354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672821+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:32:51.672821+0000","last_peered":"2024-01-27T13:32:51.672821+0000","last_clean":"2024-01-27T13:32:51.672821+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:32:51.672821+0000","last_undegraded":"2024-01-27T13:32:51.672821+0000","last_fullsized":"2024-01-27T13:32:51.672821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.718659+0000","last_change":"2024-01-27T13:32:51.718659+0000","last_active":"2024-01-27T13:32:51.718659+0000","last_peered":"2024-01-27T13:32:51.718659+0000","last_clean":"2024-01-27T13:32:51.718659+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T13:32:51.718659+0000","last_undegraded":"2024-01-27T13:32:51.718659+0000","last_fullsized":"2024-01-27T13:32:51.718659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:10:31.041312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.664210+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:32:51.664210+0000","last_peered":"2024-01-27T13:32:51.664210+0000","last_clean":"2024-01-27T13:32:51.664210+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:32:51.664210+0000","last_undegraded":"2024-01-27T13:32:51.664210+0000","last_fullsized":"2024-01-27T13:32:51.664210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672540+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:32:51.672540+0000","last_peered":"2024-01-27T13:32:51.672540+0000","last_clean":"2024-01-27T13:32:51.672540+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:32:51.672540+0000","last_undegraded":"2024-01-27T13:32:51.672540+0000","last_fullsized":"2024-01-27T13:32:51.672540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673578+0000","last_change":"2024-01-27T13:32:51.673578+0000","last_active":"2024-01-27T13:32:51.673578+0000","last_peered":"2024-01-27T13:32:51.673578+0000","last_clean":"2024-01-27T13:32:51.673578+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T13:32:51.673578+0000","last_undegraded":"2024-01-27T13:32:51.673578+0000","last_fullsized":"2024-01-27T13:32:51.673578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.714331+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:32:51.714331+0000","last_peered":"2024-01-27T13:32:51.714331+0000","last_clean":"2024-01-27T13:32:51.714331+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:32:51.714331+0000","last_undegraded":"2024-01-27T13:32:51.714331+0000","last_fullsized":"2024-01-27T13:32:51.714331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666532+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:32:51.666532+0000","last_peered":"2024-01-27T13:32:51.666532+0000","last_clean":"2024-01-27T13:32:51.666532+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:32:51.666532+0000","last_undegraded":"2024-01-27T13:32:51.666532+0000","last_fullsized":"2024-01-27T13:32:51.666532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659956+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T13:32:51.659956+0000","last_peered":"2024-01-27T13:32:51.659956+0000","last_clean":"2024-01-27T13:32:51.659956+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T13:32:51.659956+0000","last_undegraded":"2024-01-27T13:32:51.659956+0000","last_fullsized":"2024-01-27T13:32:51.659956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663272+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:32:51.663272+0000","last_peered":"2024-01-27T13:32:51.663272+0000","last_clean":"2024-01-27T13:32:51.663272+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:32:51.663272+0000","last_undegraded":"2024-01-27T13:32:51.663272+0000","last_fullsized":"2024-01-27T13:32:51.663272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.704965+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:32:51.704965+0000","last_peered":"2024-01-27T13:32:51.704965+0000","last_clean":"2024-01-27T13:32:51.704965+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:32:51.704965+0000","last_undegraded":"2024-01-27T13:32:51.704965+0000","last_fullsized":"2024-01-27T13:32:51.704965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659790+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T13:32:51.659790+0000","last_peered":"2024-01-27T13:32:51.659790+0000","last_clean":"2024-01-27T13:32:51.659790+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T13:32:51.659790+0000","last_undegraded":"2024-01-27T13:32:51.659790+0000","last_fullsized":"2024-01-27T13:32:51.659790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667275+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:32:51.667275+0000","last_peered":"2024-01-27T13:32:51.667275+0000","last_clean":"2024-01-27T13:32:51.667275+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:32:51.667275+0000","last_undegraded":"2024-01-27T13:32:51.667275+0000","last_fullsized":"2024-01-27T13:32:51.667275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666418+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:32:51.666418+0000","last_peered":"2024-01-27T13:32:51.666418+0000","last_clean":"2024-01-27T13:32:51.666418+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:32:51.666418+0000","last_undegraded":"2024-01-27T13:32:51.666418+0000","last_fullsized":"2024-01-27T13:32:51.666418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659462+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T13:32:51.659462+0000","last_peered":"2024-01-27T13:32:51.659462+0000","last_clean":"2024-01-27T13:32:51.659462+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T13:32:51.659462+0000","last_undegraded":"2024-01-27T13:32:51.659462+0000","last_fullsized":"2024-01-27T13:32:51.659462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663339+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:32:51.663339+0000","last_peered":"2024-01-27T13:32:51.663339+0000","last_clean":"2024-01-27T13:32:51.663339+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:32:51.663339+0000","last_undegraded":"2024-01-27T13:32:51.663339+0000","last_fullsized":"2024-01-27T13:32:51.663339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667652+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:32:51.667652+0000","last_peered":"2024-01-27T13:32:51.667652+0000","last_clean":"2024-01-27T13:32:51.667652+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:32:51.667652+0000","last_undegraded":"2024-01-27T13:32:51.667652+0000","last_fullsized":"2024-01-27T13:32:51.667652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672595+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T13:32:51.672595+0000","last_peered":"2024-01-27T13:32:51.672595+0000","last_clean":"2024-01-27T13:32:51.672595+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T13:32:51.672595+0000","last_undegraded":"2024-01-27T13:32:51.672595+0000","last_fullsized":"2024-01-27T13:32:51.672595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672712+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:32:51.672712+0000","last_peered":"2024-01-27T13:32:51.672712+0000","last_clean":"2024-01-27T13:32:51.672712+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:32:51.672712+0000","last_undegraded":"2024-01-27T13:32:51.672712+0000","last_fullsized":"2024-01-27T13:32:51.672712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670815+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:32:51.670815+0000","last_peered":"2024-01-27T13:32:51.670815+0000","last_clean":"2024-01-27T13:32:51.670815+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:32:51.670815+0000","last_undegraded":"2024-01-27T13:32:51.670815+0000","last_fullsized":"2024-01-27T13:32:51.670815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659556+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T13:32:51.659556+0000","last_peered":"2024-01-27T13:32:51.659556+0000","last_clean":"2024-01-27T13:32:51.659556+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T13:32:51.659556+0000","last_undegraded":"2024-01-27T13:32:51.659556+0000","last_fullsized":"2024-01-27T13:32:51.659556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705508+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:32:51.705508+0000","last_peered":"2024-01-27T13:32:51.705508+0000","last_clean":"2024-01-27T13:32:51.705508+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:32:51.705508+0000","last_undegraded":"2024-01-27T13:32:51.705508+0000","last_fullsized":"2024-01-27T13:32:51.705508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671322+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:32:51.671322+0000","last_peered":"2024-01-27T13:32:51.671322+0000","last_clean":"2024-01-27T13:32:51.671322+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:32:51.671322+0000","last_undegraded":"2024-01-27T13:32:51.671322+0000","last_fullsized":"2024-01-27T13:32:51.671322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666144+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T13:32:51.666144+0000","last_peered":"2024-01-27T13:32:51.666144+0000","last_clean":"2024-01-27T13:32:51.666144+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T13:32:51.666144+0000","last_undegraded":"2024-01-27T13:32:51.666144+0000","last_fullsized":"2024-01-27T13:32:51.666144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666790+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:32:51.666790+0000","last_peered":"2024-01-27T13:32:51.666790+0000","last_clean":"2024-01-27T13:32:51.666790+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:32:51.666790+0000","last_undegraded":"2024-01-27T13:32:51.666790+0000","last_fullsized":"2024-01-27T13:32:51.666790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705605+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:32:51.705605+0000","last_peered":"2024-01-27T13:32:51.705605+0000","last_clean":"2024-01-27T13:32:51.705605+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:32:51.705605+0000","last_undegraded":"2024-01-27T13:32:51.705605+0000","last_fullsized":"2024-01-27T13:32:51.705605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659564+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T13:32:51.659564+0000","last_peered":"2024-01-27T13:32:51.659564+0000","last_clean":"2024-01-27T13:32:51.659564+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T13:32:51.659564+0000","last_undegraded":"2024-01-27T13:32:51.659564+0000","last_fullsized":"2024-01-27T13:32:51.659564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673061+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:32:51.673061+0000","last_peered":"2024-01-27T13:32:51.673061+0000","last_clean":"2024-01-27T13:32:51.673061+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:32:51.673061+0000","last_undegraded":"2024-01-27T13:32:51.673061+0000","last_fullsized":"2024-01-27T13:32:51.673061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707291+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:32:51.707291+0000","last_peered":"2024-01-27T13:32:51.707291+0000","last_clean":"2024-01-27T13:32:51.707291+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:32:51.707291+0000","last_undegraded":"2024-01-27T13:32:51.707291+0000","last_fullsized":"2024-01-27T13:32:51.707291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667147+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T13:32:51.667147+0000","last_peered":"2024-01-27T13:32:51.667147+0000","last_clean":"2024-01-27T13:32:51.667147+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T13:32:51.667147+0000","last_undegraded":"2024-01-27T13:32:51.667147+0000","last_fullsized":"2024-01-27T13:32:51.667147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.714233+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:32:51.714233+0000","last_peered":"2024-01-27T13:32:51.714233+0000","last_clean":"2024-01-27T13:32:51.714233+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:32:51.714233+0000","last_undegraded":"2024-01-27T13:32:51.714233+0000","last_fullsized":"2024-01-27T13:32:51.714233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666886+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:32:51.666886+0000","last_peered":"2024-01-27T13:32:51.666886+0000","last_clean":"2024-01-27T13:32:51.666886+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:32:51.666886+0000","last_undegraded":"2024-01-27T13:32:51.666886+0000","last_fullsized":"2024-01-27T13:32:51.666886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669720+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T13:32:51.669720+0000","last_peered":"2024-01-27T13:32:51.669720+0000","last_clean":"2024-01-27T13:32:51.669720+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T13:32:51.669720+0000","last_undegraded":"2024-01-27T13:32:51.669720+0000","last_fullsized":"2024-01-27T13:32:51.669720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705334+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:32:51.705334+0000","last_peered":"2024-01-27T13:32:51.705334+0000","last_clean":"2024-01-27T13:32:51.705334+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:32:51.705334+0000","last_undegraded":"2024-01-27T13:32:51.705334+0000","last_fullsized":"2024-01-27T13:32:51.705334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672173+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:32:51.672173+0000","last_peered":"2024-01-27T13:32:51.672173+0000","last_clean":"2024-01-27T13:32:51.672173+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:32:51.672173+0000","last_undegraded":"2024-01-27T13:32:51.672173+0000","last_fullsized":"2024-01-27T13:32:51.672173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705309+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T13:32:51.705309+0000","last_peered":"2024-01-27T13:32:51.705309+0000","last_clean":"2024-01-27T13:32:51.705309+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T13:32:51.705309+0000","last_undegraded":"2024-01-27T13:32:51.705309+0000","last_fullsized":"2024-01-27T13:32:51.705309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673175+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:32:51.673175+0000","last_peered":"2024-01-27T13:32:51.673175+0000","last_clean":"2024-01-27T13:32:51.673175+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:32:51.673175+0000","last_undegraded":"2024-01-27T13:32:51.673175+0000","last_fullsized":"2024-01-27T13:32:51.673175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669545+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:32:51.669545+0000","last_peered":"2024-01-27T13:32:51.669545+0000","last_clean":"2024-01-27T13:32:51.669545+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:32:51.669545+0000","last_undegraded":"2024-01-27T13:32:51.669545+0000","last_fullsized":"2024-01-27T13:32:51.669545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667546+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:32:51.667546+0000","last_peered":"2024-01-27T13:32:51.667546+0000","last_clean":"2024-01-27T13:32:51.667546+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:32:51.667546+0000","last_undegraded":"2024-01-27T13:32:51.667546+0000","last_fullsized":"2024-01-27T13:32:51.667546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.706805+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T13:32:51.706805+0000","last_peered":"2024-01-27T13:32:51.706805+0000","last_clean":"2024-01-27T13:32:51.706805+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T13:32:51.706805+0000","last_undegraded":"2024-01-27T13:32:51.706805+0000","last_fullsized":"2024-01-27T13:32:51.706805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705223+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:32:51.705223+0000","last_peered":"2024-01-27T13:32:51.705223+0000","last_clean":"2024-01-27T13:32:51.705223+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:32:51.705223+0000","last_undegraded":"2024-01-27T13:32:51.705223+0000","last_fullsized":"2024-01-27T13:32:51.705223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707209+0000","last_change":"2024-01-27T13:32:51.707209+0000","last_active":"2024-01-27T13:32:51.707209+0000","last_peered":"2024-01-27T13:32:51.707209+0000","last_clean":"2024-01-27T13:32:51.707209+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T13:32:51.707209+0000","last_undegraded":"2024-01-27T13:32:51.707209+0000","last_fullsized":"2024-01-27T13:32:51.707209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:40.489268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672264+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T13:32:51.672264+0000","last_peered":"2024-01-27T13:32:51.672264+0000","last_clean":"2024-01-27T13:32:51.672264+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T13:32:51.672264+0000","last_undegraded":"2024-01-27T13:32:51.672264+0000","last_fullsized":"2024-01-27T13:32:51.672264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669827+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:32:51.669827+0000","last_peered":"2024-01-27T13:32:51.669827+0000","last_clean":"2024-01-27T13:32:51.669827+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:32:51.669827+0000","last_undegraded":"2024-01-27T13:32:51.669827+0000","last_fullsized":"2024-01-27T13:32:51.669827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672929+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:32:51.672929+0000","last_peered":"2024-01-27T13:32:51.672929+0000","last_clean":"2024-01-27T13:32:51.672929+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:32:51.672929+0000","last_undegraded":"2024-01-27T13:32:51.672929+0000","last_fullsized":"2024-01-27T13:32:51.672929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666704+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T13:32:51.666704+0000","last_peered":"2024-01-27T13:32:51.666704+0000","last_clean":"2024-01-27T13:32:51.666704+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T13:32:51.666704+0000","last_undegraded":"2024-01-27T13:32:51.666704+0000","last_fullsized":"2024-01-27T13:32:51.666704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.664005+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:32:51.664005+0000","last_peered":"2024-01-27T13:32:51.664005+0000","last_clean":"2024-01-27T13:32:51.664005+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:32:51.664005+0000","last_undegraded":"2024-01-27T13:32:51.664005+0000","last_fullsized":"2024-01-27T13:32:51.664005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671715+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:32:51.671715+0000","last_peered":"2024-01-27T13:32:51.671715+0000","last_clean":"2024-01-27T13:32:51.671715+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:32:51.671715+0000","last_undegraded":"2024-01-27T13:32:51.671715+0000","last_fullsized":"2024-01-27T13:32:51.671715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666873+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T13:32:51.666873+0000","last_peered":"2024-01-27T13:32:51.666873+0000","last_clean":"2024-01-27T13:32:51.666873+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T13:32:51.666873+0000","last_undegraded":"2024-01-27T13:32:51.666873+0000","last_fullsized":"2024-01-27T13:32:51.666873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669933+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:32:51.669933+0000","last_peered":"2024-01-27T13:32:51.669933+0000","last_clean":"2024-01-27T13:32:51.669933+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:32:51.669933+0000","last_undegraded":"2024-01-27T13:32:51.669933+0000","last_fullsized":"2024-01-27T13:32:51.669933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672503+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T13:32:51.672503+0000","last_peered":"2024-01-27T13:32:51.672503+0000","last_clean":"2024-01-27T13:32:51.672503+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T13:32:51.672503+0000","last_undegraded":"2024-01-27T13:32:51.672503+0000","last_fullsized":"2024-01-27T13:32:51.672503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663177+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T13:32:51.663177+0000","last_peered":"2024-01-27T13:32:51.663177+0000","last_clean":"2024-01-27T13:32:51.663177+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T13:32:51.663177+0000","last_undegraded":"2024-01-27T13:32:51.663177+0000","last_fullsized":"2024-01-27T13:32:51.663177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705477+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T13:32:51.705477+0000","last_peered":"2024-01-27T13:32:51.705477+0000","last_clean":"2024-01-27T13:32:51.705477+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T13:32:51.705477+0000","last_undegraded":"2024-01-27T13:32:51.705477+0000","last_fullsized":"2024-01-27T13:32:51.705477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666618+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T13:32:51.666618+0000","last_peered":"2024-01-27T13:32:51.666618+0000","last_clean":"2024-01-27T13:32:51.666618+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T13:32:51.666618+0000","last_undegraded":"2024-01-27T13:32:51.666618+0000","last_fullsized":"2024-01-27T13:32:51.666618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671614+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T13:32:51.671614+0000","last_peered":"2024-01-27T13:32:51.671614+0000","last_clean":"2024-01-27T13:32:51.671614+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T13:32:51.671614+0000","last_undegraded":"2024-01-27T13:32:51.671614+0000","last_fullsized":"2024-01-27T13:32:51.671614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.714082+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T13:32:51.714082+0000","last_peered":"2024-01-27T13:32:51.714082+0000","last_clean":"2024-01-27T13:32:51.714082+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T13:32:51.714082+0000","last_undegraded":"2024-01-27T13:32:51.714082+0000","last_fullsized":"2024-01-27T13:32:51.714082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673178+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T13:32:51.673178+0000","last_peered":"2024-01-27T13:32:51.673178+0000","last_clean":"2024-01-27T13:32:51.673178+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T13:32:51.673178+0000","last_undegraded":"2024-01-27T13:32:51.673178+0000","last_fullsized":"2024-01-27T13:32:51.673178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671452+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T13:32:51.671452+0000","last_peered":"2024-01-27T13:32:51.671452+0000","last_clean":"2024-01-27T13:32:51.671452+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T13:32:51.671452+0000","last_undegraded":"2024-01-27T13:32:51.671452+0000","last_fullsized":"2024-01-27T13:32:51.671452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705145+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T13:32:51.705145+0000","last_peered":"2024-01-27T13:32:51.705145+0000","last_clean":"2024-01-27T13:32:51.705145+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T13:32:51.705145+0000","last_undegraded":"2024-01-27T13:32:51.705145+0000","last_fullsized":"2024-01-27T13:32:51.705145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669744+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T13:32:51.669744+0000","last_peered":"2024-01-27T13:32:51.669744+0000","last_clean":"2024-01-27T13:32:51.669744+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T13:32:51.669744+0000","last_undegraded":"2024-01-27T13:32:51.669744+0000","last_fullsized":"2024-01-27T13:32:51.669744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705388+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T13:32:51.705388+0000","last_peered":"2024-01-27T13:32:51.705388+0000","last_clean":"2024-01-27T13:32:51.705388+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T13:32:51.705388+0000","last_undegraded":"2024-01-27T13:32:51.705388+0000","last_fullsized":"2024-01-27T13:32:51.705388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666446+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T13:32:51.666446+0000","last_peered":"2024-01-27T13:32:51.666446+0000","last_clean":"2024-01-27T13:32:51.666446+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T13:32:51.666446+0000","last_undegraded":"2024-01-27T13:32:51.666446+0000","last_fullsized":"2024-01-27T13:32:51.666446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672959+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T13:32:51.672959+0000","last_peered":"2024-01-27T13:32:51.672959+0000","last_clean":"2024-01-27T13:32:51.672959+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T13:32:51.672959+0000","last_undegraded":"2024-01-27T13:32:51.672959+0000","last_fullsized":"2024-01-27T13:32:51.672959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.660006+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T13:32:51.660006+0000","last_peered":"2024-01-27T13:32:51.660006+0000","last_clean":"2024-01-27T13:32:51.660006+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T13:32:51.660006+0000","last_undegraded":"2024-01-27T13:32:51.660006+0000","last_fullsized":"2024-01-27T13:32:51.660006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663167+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T13:32:51.663167+0000","last_peered":"2024-01-27T13:32:51.663167+0000","last_clean":"2024-01-27T13:32:51.663167+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T13:32:51.663167+0000","last_undegraded":"2024-01-27T13:32:51.663167+0000","last_fullsized":"2024-01-27T13:32:51.663167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705393+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T13:32:51.705393+0000","last_peered":"2024-01-27T13:32:51.705393+0000","last_clean":"2024-01-27T13:32:51.705393+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T13:32:51.705393+0000","last_undegraded":"2024-01-27T13:32:51.705393+0000","last_fullsized":"2024-01-27T13:32:51.705393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705064+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T13:32:51.705064+0000","last_peered":"2024-01-27T13:32:51.705064+0000","last_clean":"2024-01-27T13:32:51.705064+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T13:32:51.705064+0000","last_undegraded":"2024-01-27T13:32:51.705064+0000","last_fullsized":"2024-01-27T13:32:51.705064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.706926+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T13:32:51.706926+0000","last_peered":"2024-01-27T13:32:51.706926+0000","last_clean":"2024-01-27T13:32:51.706926+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T13:32:51.706926+0000","last_undegraded":"2024-01-27T13:32:51.706926+0000","last_fullsized":"2024-01-27T13:32:51.706926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666058+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T13:32:51.666058+0000","last_peered":"2024-01-27T13:32:51.666058+0000","last_clean":"2024-01-27T13:32:51.666058+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T13:32:51.666058+0000","last_undegraded":"2024-01-27T13:32:51.666058+0000","last_fullsized":"2024-01-27T13:32:51.666058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669457+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T13:32:51.669457+0000","last_peered":"2024-01-27T13:32:51.669457+0000","last_clean":"2024-01-27T13:32:51.669457+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T13:32:51.669457+0000","last_undegraded":"2024-01-27T13:32:51.669457+0000","last_fullsized":"2024-01-27T13:32:51.669457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667059+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T13:32:51.667059+0000","last_peered":"2024-01-27T13:32:51.667059+0000","last_clean":"2024-01-27T13:32:51.667059+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T13:32:51.667059+0000","last_undegraded":"2024-01-27T13:32:51.667059+0000","last_fullsized":"2024-01-27T13:32:51.667059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673060+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T13:32:51.673060+0000","last_peered":"2024-01-27T13:32:51.673060+0000","last_clean":"2024-01-27T13:32:51.673060+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T13:32:51.673060+0000","last_undegraded":"2024-01-27T13:32:51.673060+0000","last_fullsized":"2024-01-27T13:32:51.673060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673088+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T13:32:51.673088+0000","last_peered":"2024-01-27T13:32:51.673088+0000","last_clean":"2024-01-27T13:32:51.673088+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T13:32:51.673088+0000","last_undegraded":"2024-01-27T13:32:51.673088+0000","last_fullsized":"2024-01-27T13:32:51.673088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.706601+0000","last_change":"2024-01-27T13:32:51.706601+0000","last_active":"2024-01-27T13:32:51.706601+0000","last_peered":"2024-01-27T13:32:51.706601+0000","last_clean":"2024-01-27T13:32:51.706601+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T13:32:51.706601+0000","last_undegraded":"2024-01-27T13:32:51.706601+0000","last_fullsized":"2024-01-27T13:32:51.706601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672083+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T13:32:51.672083+0000","last_peered":"2024-01-27T13:32:51.672083+0000","last_clean":"2024-01-27T13:32:51.672083+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T13:32:51.672083+0000","last_undegraded":"2024-01-27T13:32:51.672083+0000","last_fullsized":"2024-01-27T13:32:51.672083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659380+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T13:32:51.659380+0000","last_peered":"2024-01-27T13:32:51.659380+0000","last_clean":"2024-01-27T13:32:51.659380+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T13:32:51.659380+0000","last_undegraded":"2024-01-27T13:32:51.659380+0000","last_fullsized":"2024-01-27T13:32:51.659380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705301+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T13:32:51.705301+0000","last_peered":"2024-01-27T13:32:51.705301+0000","last_clean":"2024-01-27T13:32:51.705301+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T13:32:51.705301+0000","last_undegraded":"2024-01-27T13:32:51.705301+0000","last_fullsized":"2024-01-27T13:32:51.705301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659458+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T13:32:51.659458+0000","last_peered":"2024-01-27T13:32:51.659458+0000","last_clean":"2024-01-27T13:32:51.659458+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T13:32:51.659458+0000","last_undegraded":"2024-01-27T13:32:51.659458+0000","last_fullsized":"2024-01-27T13:32:51.659458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705392+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T13:32:51.705392+0000","last_peered":"2024-01-27T13:32:51.705392+0000","last_clean":"2024-01-27T13:32:51.705392+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T13:32:51.705392+0000","last_undegraded":"2024-01-27T13:32:51.705392+0000","last_fullsized":"2024-01-27T13:32:51.705392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667214+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T13:32:51.667214+0000","last_peered":"2024-01-27T13:32:51.667214+0000","last_clean":"2024-01-27T13:32:51.667214+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T13:32:51.667214+0000","last_undegraded":"2024-01-27T13:32:51.667214+0000","last_fullsized":"2024-01-27T13:32:51.667214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708500+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T13:32:51.708500+0000","last_peered":"2024-01-27T13:32:51.708500+0000","last_clean":"2024-01-27T13:32:51.708500+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T13:32:51.708500+0000","last_undegraded":"2024-01-27T13:32:51.708500+0000","last_fullsized":"2024-01-27T13:32:51.708500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659831+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T13:32:51.659831+0000","last_peered":"2024-01-27T13:32:51.659831+0000","last_clean":"2024-01-27T13:32:51.659831+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T13:32:51.659831+0000","last_undegraded":"2024-01-27T13:32:51.659831+0000","last_fullsized":"2024-01-27T13:32:51.659831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":294912,"data_stored":120115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":116274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":116434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":707224,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":120115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6179999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":707280,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T13:32:56.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T13:32:57.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.020+0000 7fe472d68640 1 Processor -- start 2024-01-27T13:32:57.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.020+0000 7fe472d68640 1 -- start start 2024-01-27T13:32:57.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.021+0000 7fe472d68640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe46c14fc40 0x7fe46c0c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.021+0000 7fe472d68640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46c1502a0 con 0x7fe46c071950 2024-01-27T13:32:57.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.021+0000 7fe472d68640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46c155e10 con 0x7fe46c072450 2024-01-27T13:32:57.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.021+0000 7fe472d68640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c156a50 con 0x7fe46c14fc40 2024-01-27T13:32:57.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.021+0000 7fe471305640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe46c071950 0x7fe46c160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47090/0 (socket says 172.21.15.46:47090) 2024-01-27T13:32:57.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.021+0000 7fe471305640 1 -- 172.21.15.46:0/208888621 learned_addr learned my addr 172.21.15.46:0/208888621 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.024+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363810910 0 0) 0x7fe46c1502a0 con 0x7fe46c071950 2024-01-27T13:32:57.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.024+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe45c003440 con 0x7fe46c071950 2024-01-27T13:32:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 <== mon.0 v1:172.21.15.46:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053594388 0 0) 0x7fe45c003440 con 0x7fe46c071950 2024-01-27T13:32:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 >> v2:172.21.15.78:3300/0 conn(0x7fe46c14fc40 msgr2=0x7fe46c0c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 --2- 172.21.15.46:0/208888621 >> v2:172.21.15.78:3300/0 conn(0x7fe46c14fc40 0x7fe46c0c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 >> v1:172.21.15.78:6789/0 conn(0x7fe46c072450 legacy=0x7fe46c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:57.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 --> v1:172.21.15.46:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c150020 con 0x7fe46c071950 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 <== mon.0 v1:172.21.15.46:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2887288732 0 0) 0x7fe4640019f0 con 0x7fe46c071950 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 >> v1:172.21.15.46:6789/0 conn(0x7fe46c071950 legacy=0x7fe46c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe45c003ab0 0x7fe45c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe45c0089e0 0x7fe45c00ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe45c00db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c156a50 con 0x7fe45c00b650 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c00e3f0 con 0x7fe45c0089e0 2024-01-27T13:32:57.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.027+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c00e5b0 con 0x7fe45c003ab0 2024-01-27T13:32:57.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.031+0000 7fe471305640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe45c00db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.033+0000 7fe471305640 1 -- 172.21.15.46:0/208888621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe45c003ab0 msgr2=0x7fe45c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.033+0000 7fe471305640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe45c003ab0 0x7fe45c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.033+0000 7fe471305640 1 -- 172.21.15.46:0/208888621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe45c0089e0 msgr2=0x7fe45c00ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.033+0000 7fe471305640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe45c0089e0 0x7fe45c00ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.033+0000 7fe471305640 1 -- 172.21.15.46:0/208888621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c003440 con 0x7fe45c00b650 2024-01-27T13:32:57.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.034+0000 7fe471305640 1 -- 172.21.15.46:0/208888621 reap_dead start 2024-01-27T13:32:57.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.035+0000 7fe471305640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe45c00db10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe46400a770 tx=0x7fe45c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d400b260237e19b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.039+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640072d0 con 0x7fe45c00b650 2024-01-27T13:32:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.039+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46402f070 con 0x7fe45c00b650 2024-01-27T13:32:57.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.039+0000 7fe46b7fe640 1 -- 172.21.15.46:0/208888621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640076b0 con 0x7fe45c00b650 2024-01-27T13:32:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 -- 172.21.15.46:0/208888621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 msgr2=0x7fe45c00db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe45c00db10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe46400a770 tx=0x7fe45c0036f0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 -- 172.21.15.46:0/208888621 shutdown_connections 2024-01-27T13:32:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 --2- 172.21.15.46:0/208888621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe45c00db10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 -- 172.21.15.46:0/208888621 >> 172.21.15.46:0/208888621 conn(0x7fe46c0cae90 msgr2=0x7fe46c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 -- 172.21.15.46:0/208888621 shutdown_connections 2024-01-27T13:32:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.040+0000 7fe472d68640 1 -- 172.21.15.46:0/208888621 wait complete. 2024-01-27T13:32:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.041+0000 7fe472d68640 1 Processor -- start 2024-01-27T13:32:57.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.041+0000 7fe472d68640 1 -- start start 2024-01-27T13:32:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe472d68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe46c146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe472d68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe46c14e940 0x7fe46c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe472d68640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe46c148e40 0x7fe46c1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe472d68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1489b0 con 0x7fe45c00b650 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe472d68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1486d0 con 0x7fe46c14e940 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe472d68640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c1470c0 con 0x7fe46c148e40 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe470b04640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe46c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe470b04640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe46c146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50024/0 (socket says 172.21.15.46:50024) 2024-01-27T13:32:57.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.042+0000 7fe470b04640 1 -- 172.21.15.46:0/4237271473 learned_addr learned my addr 172.21.15.46:0/4237271473 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.046+0000 7fe470b04640 1 -- 172.21.15.46:0/4237271473 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe46c148e40 msgr2=0x7fe46c1492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.046+0000 7fe470b04640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe46c148e40 0x7fe46c1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.046+0000 7fe470b04640 1 -- 172.21.15.46:0/4237271473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe46c14e940 msgr2=0x7fe46c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.046+0000 7fe470b04640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe46c14e940 0x7fe46c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.046+0000 7fe470b04640 1 -- 172.21.15.46:0/4237271473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c149800 con 0x7fe45c00b650 2024-01-27T13:32:57.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.049+0000 7fe470b04640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe46c146690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b530 tx=0x7fe46000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:57.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.058+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460010610 con 0x7fe45c00b650 2024-01-27T13:32:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.058+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460010770 con 0x7fe45c00b650 2024-01-27T13:32:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.058+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c0c4e70 con 0x7fe45c00b650 2024-01-27T13:32:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.058+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460010b20 con 0x7fe45c00b650 2024-01-27T13:32:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.058+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c147610 con 0x7fe45c00b650 2024-01-27T13:32:57.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.059+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c1477d0 con 0x7fe45c00b650 2024-01-27T13:32:57.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.079+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe460010c80 con 0x7fe45c00b650 2024-01-27T13:32:57.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.079+0000 7fe4697fa640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe45006af20 0x7fe45006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.080+0000 7fe46bfff640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe45006af20 0x7fe45006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.080+0000 7fe46bfff640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe45006af20 0x7fe45006d3e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0c5ee0 tx=0x7fe458007990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:57.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.081+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4600587a0 con 0x7fe45c00b650 2024-01-27T13:32:57.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.333+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe4600543e0 con 0x7fe45c00b650 2024-01-27T13:32:57.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.509+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe46c148840 con 0x7fe45006af20 2024-01-27T13:32:57.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.517+0000 7fe4697fa640 1 -- 172.21.15.46:0/4237271473 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345409 (secure 0 0 0) 0x7fe46c148840 con 0x7fe45006af20 2024-01-27T13:32:57.513 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:57.515 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T13:32:57.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe45006af20 msgr2=0x7fe45006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe45006af20 0x7fe45006d3e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0c5ee0 tx=0x7fe458007990 comp rx=0 tx=0).stop 2024-01-27T13:32:57.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 msgr2=0x7fe46c146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe46c146690 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b530 tx=0x7fe46000b9f0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 shutdown_connections 2024-01-27T13:32:57.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe45006af20 0x7fe45006d3e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe46c148e40 0x7fe46c1492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe46c14e940 0x7fe46c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 --2- 172.21.15.46:0/4237271473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe45c00b650 0x7fe46c146690 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 >> 172.21.15.46:0/4237271473 conn(0x7fe46c0cae90 msgr2=0x7fe46c0c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 shutdown_connections 2024-01-27T13:32:57.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.521+0000 7fe472d68640 1 -- 172.21.15.46:0/4237271473 wait complete. 2024-01-27T13:32:57.524 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-01-27T13:32:55.585412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":320,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235216,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739504,"statfs":{"total":773094113280,"available":772853252096,"internally_reserved":0,"allocated":2457600,"data_stored":2120206,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001986"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669809+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:32:51.669809+0000","last_peered":"2024-01-27T13:32:51.669809+0000","last_clean":"2024-01-27T13:32:51.669809+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:32:51.669809+0000","last_undegraded":"2024-01-27T13:32:51.669809+0000","last_fullsized":"2024-01-27T13:32:51.669809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670362+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T13:32:51.670362+0000","last_peered":"2024-01-27T13:32:51.670362+0000","last_clean":"2024-01-27T13:32:51.670362+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T13:32:51.670362+0000","last_undegraded":"2024-01-27T13:32:51.670362+0000","last_fullsized":"2024-01-27T13:32:51.670362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669450+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:32:51.669450+0000","last_peered":"2024-01-27T13:32:51.669450+0000","last_clean":"2024-01-27T13:32:51.669450+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:32:51.669450+0000","last_undegraded":"2024-01-27T13:32:51.669450+0000","last_fullsized":"2024-01-27T13:32:51.669450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670515+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:32:51.670515+0000","last_peered":"2024-01-27T13:32:51.670515+0000","last_clean":"2024-01-27T13:32:51.670515+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:32:51.670515+0000","last_undegraded":"2024-01-27T13:32:51.670515+0000","last_fullsized":"2024-01-27T13:32:51.670515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669567+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T13:32:51.669567+0000","last_peered":"2024-01-27T13:32:51.669567+0000","last_clean":"2024-01-27T13:32:51.669567+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T13:32:51.669567+0000","last_undegraded":"2024-01-27T13:32:51.669567+0000","last_fullsized":"2024-01-27T13:32:51.669567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666379+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:32:51.666379+0000","last_peered":"2024-01-27T13:32:51.666379+0000","last_clean":"2024-01-27T13:32:51.666379+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:32:51.666379+0000","last_undegraded":"2024-01-27T13:32:51.666379+0000","last_fullsized":"2024-01-27T13:32:51.666379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659943+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:32:51.659943+0000","last_peered":"2024-01-27T13:32:51.659943+0000","last_clean":"2024-01-27T13:32:51.659943+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:32:51.659943+0000","last_undegraded":"2024-01-27T13:32:51.659943+0000","last_fullsized":"2024-01-27T13:32:51.659943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705424+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T13:32:51.705424+0000","last_peered":"2024-01-27T13:32:51.705424+0000","last_clean":"2024-01-27T13:32:51.705424+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T13:32:51.705424+0000","last_undegraded":"2024-01-27T13:32:51.705424+0000","last_fullsized":"2024-01-27T13:32:51.705424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666712+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:32:51.666712+0000","last_peered":"2024-01-27T13:32:51.666712+0000","last_clean":"2024-01-27T13:32:51.666712+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:32:51.666712+0000","last_undegraded":"2024-01-27T13:32:51.666712+0000","last_fullsized":"2024-01-27T13:32:51.666712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659644+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:32:51.659644+0000","last_peered":"2024-01-27T13:32:51.659644+0000","last_clean":"2024-01-27T13:32:51.659644+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:32:51.659644+0000","last_undegraded":"2024-01-27T13:32:51.659644+0000","last_fullsized":"2024-01-27T13:32:51.659644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705649+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T13:32:51.705649+0000","last_peered":"2024-01-27T13:32:51.705649+0000","last_clean":"2024-01-27T13:32:51.705649+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T13:32:51.705649+0000","last_undegraded":"2024-01-27T13:32:51.705649+0000","last_fullsized":"2024-01-27T13:32:51.705649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666638+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:32:51.666638+0000","last_peered":"2024-01-27T13:32:51.666638+0000","last_clean":"2024-01-27T13:32:51.666638+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:32:51.666638+0000","last_undegraded":"2024-01-27T13:32:51.666638+0000","last_fullsized":"2024-01-27T13:32:51.666638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672649+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T13:32:51.672649+0000","last_peered":"2024-01-27T13:32:51.672649+0000","last_clean":"2024-01-27T13:32:51.672649+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T13:32:51.672649+0000","last_undegraded":"2024-01-27T13:32:51.672649+0000","last_fullsized":"2024-01-27T13:32:51.672649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659760+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:32:51.659760+0000","last_peered":"2024-01-27T13:32:51.659760+0000","last_clean":"2024-01-27T13:32:51.659760+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:32:51.659760+0000","last_undegraded":"2024-01-27T13:32:51.659760+0000","last_fullsized":"2024-01-27T13:32:51.659760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707357+0000","last_change":"2024-01-27T13:32:51.707357+0000","last_active":"2024-01-27T13:32:51.707357+0000","last_peered":"2024-01-27T13:32:51.707357+0000","last_clean":"2024-01-27T13:32:51.707357+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T13:32:51.707357+0000","last_undegraded":"2024-01-27T13:32:51.707357+0000","last_fullsized":"2024-01-27T13:32:51.707357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:36:27.470407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671791+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T13:32:51.671791+0000","last_peered":"2024-01-27T13:32:51.671791+0000","last_clean":"2024-01-27T13:32:51.671791+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T13:32:51.671791+0000","last_undegraded":"2024-01-27T13:32:51.671791+0000","last_fullsized":"2024-01-27T13:32:51.671791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707487+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:32:51.707487+0000","last_peered":"2024-01-27T13:32:51.707487+0000","last_clean":"2024-01-27T13:32:51.707487+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:32:51.707487+0000","last_undegraded":"2024-01-27T13:32:51.707487+0000","last_fullsized":"2024-01-27T13:32:51.707487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666947+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:32:51.666947+0000","last_peered":"2024-01-27T13:32:51.666947+0000","last_clean":"2024-01-27T13:32:51.666947+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:32:51.666947+0000","last_undegraded":"2024-01-27T13:32:51.666947+0000","last_fullsized":"2024-01-27T13:32:51.666947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.715993+0000","last_change":"2024-01-27T13:32:51.715993+0000","last_active":"2024-01-27T13:32:51.715993+0000","last_peered":"2024-01-27T13:32:51.715993+0000","last_clean":"2024-01-27T13:32:51.715993+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T13:32:51.715993+0000","last_undegraded":"2024-01-27T13:32:51.715993+0000","last_fullsized":"2024-01-27T13:32:51.715993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707014+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:32:51.707014+0000","last_peered":"2024-01-27T13:32:51.707014+0000","last_clean":"2024-01-27T13:32:51.707014+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:32:51.707014+0000","last_undegraded":"2024-01-27T13:32:51.707014+0000","last_fullsized":"2024-01-27T13:32:51.707014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708878+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:32:51.708878+0000","last_peered":"2024-01-27T13:32:51.708878+0000","last_clean":"2024-01-27T13:32:51.708878+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:32:51.708878+0000","last_undegraded":"2024-01-27T13:32:51.708878+0000","last_fullsized":"2024-01-27T13:32:51.708878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666736+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:32:51.666736+0000","last_peered":"2024-01-27T13:32:51.666736+0000","last_clean":"2024-01-27T13:32:51.666736+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:32:51.666736+0000","last_undegraded":"2024-01-27T13:32:51.666736+0000","last_fullsized":"2024-01-27T13:32:51.666736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659249+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:32:51.659249+0000","last_peered":"2024-01-27T13:32:51.659249+0000","last_clean":"2024-01-27T13:32:51.659249+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:32:51.659249+0000","last_undegraded":"2024-01-27T13:32:51.659249+0000","last_fullsized":"2024-01-27T13:32:51.659249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667057+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:32:51.667057+0000","last_peered":"2024-01-27T13:32:51.667057+0000","last_clean":"2024-01-27T13:32:51.667057+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:32:51.667057+0000","last_undegraded":"2024-01-27T13:32:51.667057+0000","last_fullsized":"2024-01-27T13:32:51.667057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667927+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T13:32:51.667927+0000","last_peered":"2024-01-27T13:32:51.667927+0000","last_clean":"2024-01-27T13:32:51.667927+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T13:32:51.667927+0000","last_undegraded":"2024-01-27T13:32:51.667927+0000","last_fullsized":"2024-01-27T13:32:51.667927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673327+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:32:51.673327+0000","last_peered":"2024-01-27T13:32:51.673327+0000","last_clean":"2024-01-27T13:32:51.673327+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:32:51.673327+0000","last_undegraded":"2024-01-27T13:32:51.673327+0000","last_fullsized":"2024-01-27T13:32:51.673327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666586+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:32:51.666586+0000","last_peered":"2024-01-27T13:32:51.666586+0000","last_clean":"2024-01-27T13:32:51.666586+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:32:51.666586+0000","last_undegraded":"2024-01-27T13:32:51.666586+0000","last_fullsized":"2024-01-27T13:32:51.666586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671553+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T13:32:51.671553+0000","last_peered":"2024-01-27T13:32:51.671553+0000","last_clean":"2024-01-27T13:32:51.671553+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T13:32:51.671553+0000","last_undegraded":"2024-01-27T13:32:51.671553+0000","last_fullsized":"2024-01-27T13:32:51.671553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708699+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:32:51.708699+0000","last_peered":"2024-01-27T13:32:51.708699+0000","last_clean":"2024-01-27T13:32:51.708699+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:32:51.708699+0000","last_undegraded":"2024-01-27T13:32:51.708699+0000","last_fullsized":"2024-01-27T13:32:51.708699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.674638+0000","last_change":"2024-01-27T13:32:51.674638+0000","last_active":"2024-01-27T13:32:51.674638+0000","last_peered":"2024-01-27T13:32:51.674638+0000","last_clean":"2024-01-27T13:32:51.674638+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T13:32:51.674638+0000","last_undegraded":"2024-01-27T13:32:51.674638+0000","last_fullsized":"2024-01-27T13:32:51.674638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:38.395479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708198+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T13:32:51.708198+0000","last_peered":"2024-01-27T13:32:51.708198+0000","last_clean":"2024-01-27T13:32:51.708198+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T13:32:51.708198+0000","last_undegraded":"2024-01-27T13:32:51.708198+0000","last_fullsized":"2024-01-27T13:32:51.708198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.660034+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:32:51.660034+0000","last_peered":"2024-01-27T13:32:51.660034+0000","last_clean":"2024-01-27T13:32:51.660034+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:32:51.660034+0000","last_undegraded":"2024-01-27T13:32:51.660034+0000","last_fullsized":"2024-01-27T13:32:51.660034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666357+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:32:51.666357+0000","last_peered":"2024-01-27T13:32:51.666357+0000","last_clean":"2024-01-27T13:32:51.666357+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:32:51.666357+0000","last_undegraded":"2024-01-27T13:32:51.666357+0000","last_fullsized":"2024-01-27T13:32:51.666357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705690+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T13:32:51.705690+0000","last_peered":"2024-01-27T13:32:51.705690+0000","last_clean":"2024-01-27T13:32:51.705690+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T13:32:51.705690+0000","last_undegraded":"2024-01-27T13:32:51.705690+0000","last_fullsized":"2024-01-27T13:32:51.705690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708281+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:32:51.708281+0000","last_peered":"2024-01-27T13:32:51.708281+0000","last_clean":"2024-01-27T13:32:51.708281+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:32:51.708281+0000","last_undegraded":"2024-01-27T13:32:51.708281+0000","last_fullsized":"2024-01-27T13:32:51.708281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707114+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:32:51.707114+0000","last_peered":"2024-01-27T13:32:51.707114+0000","last_clean":"2024-01-27T13:32:51.707114+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:32:51.707114+0000","last_undegraded":"2024-01-27T13:32:51.707114+0000","last_fullsized":"2024-01-27T13:32:51.707114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666998+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T13:32:51.666998+0000","last_peered":"2024-01-27T13:32:51.666998+0000","last_clean":"2024-01-27T13:32:51.666998+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T13:32:51.666998+0000","last_undegraded":"2024-01-27T13:32:51.666998+0000","last_fullsized":"2024-01-27T13:32:51.666998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705568+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:32:51.705568+0000","last_peered":"2024-01-27T13:32:51.705568+0000","last_clean":"2024-01-27T13:32:51.705568+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:32:51.705568+0000","last_undegraded":"2024-01-27T13:32:51.705568+0000","last_fullsized":"2024-01-27T13:32:51.705568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708047+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:32:51.708047+0000","last_peered":"2024-01-27T13:32:51.708047+0000","last_clean":"2024-01-27T13:32:51.708047+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:32:51.708047+0000","last_undegraded":"2024-01-27T13:32:51.708047+0000","last_fullsized":"2024-01-27T13:32:51.708047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.712868+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T13:32:51.712868+0000","last_peered":"2024-01-27T13:32:51.712868+0000","last_clean":"2024-01-27T13:32:51.712868+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T13:32:51.712868+0000","last_undegraded":"2024-01-27T13:32:51.712868+0000","last_fullsized":"2024-01-27T13:32:51.712868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663265+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T13:32:51.663265+0000","last_peered":"2024-01-27T13:32:51.663265+0000","last_clean":"2024-01-27T13:32:51.663265+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T13:32:51.663265+0000","last_undegraded":"2024-01-27T13:32:51.663265+0000","last_fullsized":"2024-01-27T13:32:51.663265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708976+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:32:51.708976+0000","last_peered":"2024-01-27T13:32:51.708976+0000","last_clean":"2024-01-27T13:32:51.708976+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:32:51.708976+0000","last_undegraded":"2024-01-27T13:32:51.708976+0000","last_fullsized":"2024-01-27T13:32:51.708976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669924+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T13:32:51.669924+0000","last_peered":"2024-01-27T13:32:51.669924+0000","last_clean":"2024-01-27T13:32:51.669924+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T13:32:51.669924+0000","last_undegraded":"2024-01-27T13:32:51.669924+0000","last_fullsized":"2024-01-27T13:32:51.669924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659350+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T13:32:51.659350+0000","last_peered":"2024-01-27T13:32:51.659350+0000","last_clean":"2024-01-27T13:32:51.659350+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T13:32:51.659350+0000","last_undegraded":"2024-01-27T13:32:51.659350+0000","last_fullsized":"2024-01-27T13:32:51.659350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667756+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:32:51.667756+0000","last_peered":"2024-01-27T13:32:51.667756+0000","last_clean":"2024-01-27T13:32:51.667756+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:32:51.667756+0000","last_undegraded":"2024-01-27T13:32:51.667756+0000","last_fullsized":"2024-01-27T13:32:51.667756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670048+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T13:32:51.670048+0000","last_peered":"2024-01-27T13:32:51.670048+0000","last_clean":"2024-01-27T13:32:51.670048+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T13:32:51.670048+0000","last_undegraded":"2024-01-27T13:32:51.670048+0000","last_fullsized":"2024-01-27T13:32:51.670048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705733+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:32:51.705733+0000","last_peered":"2024-01-27T13:32:51.705733+0000","last_clean":"2024-01-27T13:32:51.705733+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:32:51.705733+0000","last_undegraded":"2024-01-27T13:32:51.705733+0000","last_fullsized":"2024-01-27T13:32:51.705733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659354+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:32:51.659354+0000","last_peered":"2024-01-27T13:32:51.659354+0000","last_clean":"2024-01-27T13:32:51.659354+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:32:51.659354+0000","last_undegraded":"2024-01-27T13:32:51.659354+0000","last_fullsized":"2024-01-27T13:32:51.659354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672821+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:32:51.672821+0000","last_peered":"2024-01-27T13:32:51.672821+0000","last_clean":"2024-01-27T13:32:51.672821+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:32:51.672821+0000","last_undegraded":"2024-01-27T13:32:51.672821+0000","last_fullsized":"2024-01-27T13:32:51.672821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.718659+0000","last_change":"2024-01-27T13:32:51.718659+0000","last_active":"2024-01-27T13:32:51.718659+0000","last_peered":"2024-01-27T13:32:51.718659+0000","last_clean":"2024-01-27T13:32:51.718659+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T13:32:51.718659+0000","last_undegraded":"2024-01-27T13:32:51.718659+0000","last_fullsized":"2024-01-27T13:32:51.718659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:10:31.041312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.664210+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:32:51.664210+0000","last_peered":"2024-01-27T13:32:51.664210+0000","last_clean":"2024-01-27T13:32:51.664210+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:32:51.664210+0000","last_undegraded":"2024-01-27T13:32:51.664210+0000","last_fullsized":"2024-01-27T13:32:51.664210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672540+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:32:51.672540+0000","last_peered":"2024-01-27T13:32:51.672540+0000","last_clean":"2024-01-27T13:32:51.672540+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:32:51.672540+0000","last_undegraded":"2024-01-27T13:32:51.672540+0000","last_fullsized":"2024-01-27T13:32:51.672540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673578+0000","last_change":"2024-01-27T13:32:51.673578+0000","last_active":"2024-01-27T13:32:51.673578+0000","last_peered":"2024-01-27T13:32:51.673578+0000","last_clean":"2024-01-27T13:32:51.673578+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T13:32:51.673578+0000","last_undegraded":"2024-01-27T13:32:51.673578+0000","last_fullsized":"2024-01-27T13:32:51.673578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.714331+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:32:51.714331+0000","last_peered":"2024-01-27T13:32:51.714331+0000","last_clean":"2024-01-27T13:32:51.714331+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:32:51.714331+0000","last_undegraded":"2024-01-27T13:32:51.714331+0000","last_fullsized":"2024-01-27T13:32:51.714331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666532+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:32:51.666532+0000","last_peered":"2024-01-27T13:32:51.666532+0000","last_clean":"2024-01-27T13:32:51.666532+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:32:51.666532+0000","last_undegraded":"2024-01-27T13:32:51.666532+0000","last_fullsized":"2024-01-27T13:32:51.666532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659956+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T13:32:51.659956+0000","last_peered":"2024-01-27T13:32:51.659956+0000","last_clean":"2024-01-27T13:32:51.659956+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T13:32:51.659956+0000","last_undegraded":"2024-01-27T13:32:51.659956+0000","last_fullsized":"2024-01-27T13:32:51.659956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663272+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:32:51.663272+0000","last_peered":"2024-01-27T13:32:51.663272+0000","last_clean":"2024-01-27T13:32:51.663272+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:32:51.663272+0000","last_undegraded":"2024-01-27T13:32:51.663272+0000","last_fullsized":"2024-01-27T13:32:51.663272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.704965+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:32:51.704965+0000","last_peered":"2024-01-27T13:32:51.704965+0000","last_clean":"2024-01-27T13:32:51.704965+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:32:51.704965+0000","last_undegraded":"2024-01-27T13:32:51.704965+0000","last_fullsized":"2024-01-27T13:32:51.704965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659790+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T13:32:51.659790+0000","last_peered":"2024-01-27T13:32:51.659790+0000","last_clean":"2024-01-27T13:32:51.659790+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T13:32:51.659790+0000","last_undegraded":"2024-01-27T13:32:51.659790+0000","last_fullsized":"2024-01-27T13:32:51.659790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667275+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:32:51.667275+0000","last_peered":"2024-01-27T13:32:51.667275+0000","last_clean":"2024-01-27T13:32:51.667275+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:32:51.667275+0000","last_undegraded":"2024-01-27T13:32:51.667275+0000","last_fullsized":"2024-01-27T13:32:51.667275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666418+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:32:51.666418+0000","last_peered":"2024-01-27T13:32:51.666418+0000","last_clean":"2024-01-27T13:32:51.666418+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:32:51.666418+0000","last_undegraded":"2024-01-27T13:32:51.666418+0000","last_fullsized":"2024-01-27T13:32:51.666418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659462+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T13:32:51.659462+0000","last_peered":"2024-01-27T13:32:51.659462+0000","last_clean":"2024-01-27T13:32:51.659462+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T13:32:51.659462+0000","last_undegraded":"2024-01-27T13:32:51.659462+0000","last_fullsized":"2024-01-27T13:32:51.659462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663339+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:32:51.663339+0000","last_peered":"2024-01-27T13:32:51.663339+0000","last_clean":"2024-01-27T13:32:51.663339+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:32:51.663339+0000","last_undegraded":"2024-01-27T13:32:51.663339+0000","last_fullsized":"2024-01-27T13:32:51.663339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667652+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:32:51.667652+0000","last_peered":"2024-01-27T13:32:51.667652+0000","last_clean":"2024-01-27T13:32:51.667652+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:32:51.667652+0000","last_undegraded":"2024-01-27T13:32:51.667652+0000","last_fullsized":"2024-01-27T13:32:51.667652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672595+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T13:32:51.672595+0000","last_peered":"2024-01-27T13:32:51.672595+0000","last_clean":"2024-01-27T13:32:51.672595+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T13:32:51.672595+0000","last_undegraded":"2024-01-27T13:32:51.672595+0000","last_fullsized":"2024-01-27T13:32:51.672595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672712+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:32:51.672712+0000","last_peered":"2024-01-27T13:32:51.672712+0000","last_clean":"2024-01-27T13:32:51.672712+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:32:51.672712+0000","last_undegraded":"2024-01-27T13:32:51.672712+0000","last_fullsized":"2024-01-27T13:32:51.672712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.670815+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:32:51.670815+0000","last_peered":"2024-01-27T13:32:51.670815+0000","last_clean":"2024-01-27T13:32:51.670815+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:32:51.670815+0000","last_undegraded":"2024-01-27T13:32:51.670815+0000","last_fullsized":"2024-01-27T13:32:51.670815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659556+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T13:32:51.659556+0000","last_peered":"2024-01-27T13:32:51.659556+0000","last_clean":"2024-01-27T13:32:51.659556+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T13:32:51.659556+0000","last_undegraded":"2024-01-27T13:32:51.659556+0000","last_fullsized":"2024-01-27T13:32:51.659556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705508+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:32:51.705508+0000","last_peered":"2024-01-27T13:32:51.705508+0000","last_clean":"2024-01-27T13:32:51.705508+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:32:51.705508+0000","last_undegraded":"2024-01-27T13:32:51.705508+0000","last_fullsized":"2024-01-27T13:32:51.705508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671322+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:32:51.671322+0000","last_peered":"2024-01-27T13:32:51.671322+0000","last_clean":"2024-01-27T13:32:51.671322+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:32:51.671322+0000","last_undegraded":"2024-01-27T13:32:51.671322+0000","last_fullsized":"2024-01-27T13:32:51.671322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666144+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T13:32:51.666144+0000","last_peered":"2024-01-27T13:32:51.666144+0000","last_clean":"2024-01-27T13:32:51.666144+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T13:32:51.666144+0000","last_undegraded":"2024-01-27T13:32:51.666144+0000","last_fullsized":"2024-01-27T13:32:51.666144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666790+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:32:51.666790+0000","last_peered":"2024-01-27T13:32:51.666790+0000","last_clean":"2024-01-27T13:32:51.666790+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:32:51.666790+0000","last_undegraded":"2024-01-27T13:32:51.666790+0000","last_fullsized":"2024-01-27T13:32:51.666790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705605+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:32:51.705605+0000","last_peered":"2024-01-27T13:32:51.705605+0000","last_clean":"2024-01-27T13:32:51.705605+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:32:51.705605+0000","last_undegraded":"2024-01-27T13:32:51.705605+0000","last_fullsized":"2024-01-27T13:32:51.705605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659564+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T13:32:51.659564+0000","last_peered":"2024-01-27T13:32:51.659564+0000","last_clean":"2024-01-27T13:32:51.659564+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T13:32:51.659564+0000","last_undegraded":"2024-01-27T13:32:51.659564+0000","last_fullsized":"2024-01-27T13:32:51.659564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673061+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:32:51.673061+0000","last_peered":"2024-01-27T13:32:51.673061+0000","last_clean":"2024-01-27T13:32:51.673061+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:32:51.673061+0000","last_undegraded":"2024-01-27T13:32:51.673061+0000","last_fullsized":"2024-01-27T13:32:51.673061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707291+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:32:51.707291+0000","last_peered":"2024-01-27T13:32:51.707291+0000","last_clean":"2024-01-27T13:32:51.707291+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:32:51.707291+0000","last_undegraded":"2024-01-27T13:32:51.707291+0000","last_fullsized":"2024-01-27T13:32:51.707291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667147+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T13:32:51.667147+0000","last_peered":"2024-01-27T13:32:51.667147+0000","last_clean":"2024-01-27T13:32:51.667147+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T13:32:51.667147+0000","last_undegraded":"2024-01-27T13:32:51.667147+0000","last_fullsized":"2024-01-27T13:32:51.667147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.714233+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:32:51.714233+0000","last_peered":"2024-01-27T13:32:51.714233+0000","last_clean":"2024-01-27T13:32:51.714233+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:32:51.714233+0000","last_undegraded":"2024-01-27T13:32:51.714233+0000","last_fullsized":"2024-01-27T13:32:51.714233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666886+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:32:51.666886+0000","last_peered":"2024-01-27T13:32:51.666886+0000","last_clean":"2024-01-27T13:32:51.666886+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:32:51.666886+0000","last_undegraded":"2024-01-27T13:32:51.666886+0000","last_fullsized":"2024-01-27T13:32:51.666886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669720+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T13:32:51.669720+0000","last_peered":"2024-01-27T13:32:51.669720+0000","last_clean":"2024-01-27T13:32:51.669720+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T13:32:51.669720+0000","last_undegraded":"2024-01-27T13:32:51.669720+0000","last_fullsized":"2024-01-27T13:32:51.669720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705334+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:32:51.705334+0000","last_peered":"2024-01-27T13:32:51.705334+0000","last_clean":"2024-01-27T13:32:51.705334+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:32:51.705334+0000","last_undegraded":"2024-01-27T13:32:51.705334+0000","last_fullsized":"2024-01-27T13:32:51.705334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672173+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:32:51.672173+0000","last_peered":"2024-01-27T13:32:51.672173+0000","last_clean":"2024-01-27T13:32:51.672173+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:32:51.672173+0000","last_undegraded":"2024-01-27T13:32:51.672173+0000","last_fullsized":"2024-01-27T13:32:51.672173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705309+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T13:32:51.705309+0000","last_peered":"2024-01-27T13:32:51.705309+0000","last_clean":"2024-01-27T13:32:51.705309+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T13:32:51.705309+0000","last_undegraded":"2024-01-27T13:32:51.705309+0000","last_fullsized":"2024-01-27T13:32:51.705309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673175+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:32:51.673175+0000","last_peered":"2024-01-27T13:32:51.673175+0000","last_clean":"2024-01-27T13:32:51.673175+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:32:51.673175+0000","last_undegraded":"2024-01-27T13:32:51.673175+0000","last_fullsized":"2024-01-27T13:32:51.673175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669545+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:32:51.669545+0000","last_peered":"2024-01-27T13:32:51.669545+0000","last_clean":"2024-01-27T13:32:51.669545+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:32:51.669545+0000","last_undegraded":"2024-01-27T13:32:51.669545+0000","last_fullsized":"2024-01-27T13:32:51.669545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667546+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:32:51.667546+0000","last_peered":"2024-01-27T13:32:51.667546+0000","last_clean":"2024-01-27T13:32:51.667546+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:32:51.667546+0000","last_undegraded":"2024-01-27T13:32:51.667546+0000","last_fullsized":"2024-01-27T13:32:51.667546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.706805+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T13:32:51.706805+0000","last_peered":"2024-01-27T13:32:51.706805+0000","last_clean":"2024-01-27T13:32:51.706805+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T13:32:51.706805+0000","last_undegraded":"2024-01-27T13:32:51.706805+0000","last_fullsized":"2024-01-27T13:32:51.706805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705223+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:32:51.705223+0000","last_peered":"2024-01-27T13:32:51.705223+0000","last_clean":"2024-01-27T13:32:51.705223+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:32:51.705223+0000","last_undegraded":"2024-01-27T13:32:51.705223+0000","last_fullsized":"2024-01-27T13:32:51.705223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.707209+0000","last_change":"2024-01-27T13:32:51.707209+0000","last_active":"2024-01-27T13:32:51.707209+0000","last_peered":"2024-01-27T13:32:51.707209+0000","last_clean":"2024-01-27T13:32:51.707209+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T13:32:51.707209+0000","last_undegraded":"2024-01-27T13:32:51.707209+0000","last_fullsized":"2024-01-27T13:32:51.707209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:40.489268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672264+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T13:32:51.672264+0000","last_peered":"2024-01-27T13:32:51.672264+0000","last_clean":"2024-01-27T13:32:51.672264+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T13:32:51.672264+0000","last_undegraded":"2024-01-27T13:32:51.672264+0000","last_fullsized":"2024-01-27T13:32:51.672264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669827+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:32:51.669827+0000","last_peered":"2024-01-27T13:32:51.669827+0000","last_clean":"2024-01-27T13:32:51.669827+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:32:51.669827+0000","last_undegraded":"2024-01-27T13:32:51.669827+0000","last_fullsized":"2024-01-27T13:32:51.669827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672929+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:32:51.672929+0000","last_peered":"2024-01-27T13:32:51.672929+0000","last_clean":"2024-01-27T13:32:51.672929+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:32:51.672929+0000","last_undegraded":"2024-01-27T13:32:51.672929+0000","last_fullsized":"2024-01-27T13:32:51.672929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666704+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T13:32:51.666704+0000","last_peered":"2024-01-27T13:32:51.666704+0000","last_clean":"2024-01-27T13:32:51.666704+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T13:32:51.666704+0000","last_undegraded":"2024-01-27T13:32:51.666704+0000","last_fullsized":"2024-01-27T13:32:51.666704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.664005+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:32:51.664005+0000","last_peered":"2024-01-27T13:32:51.664005+0000","last_clean":"2024-01-27T13:32:51.664005+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:32:51.664005+0000","last_undegraded":"2024-01-27T13:32:51.664005+0000","last_fullsized":"2024-01-27T13:32:51.664005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671715+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:32:51.671715+0000","last_peered":"2024-01-27T13:32:51.671715+0000","last_clean":"2024-01-27T13:32:51.671715+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:32:51.671715+0000","last_undegraded":"2024-01-27T13:32:51.671715+0000","last_fullsized":"2024-01-27T13:32:51.671715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666873+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T13:32:51.666873+0000","last_peered":"2024-01-27T13:32:51.666873+0000","last_clean":"2024-01-27T13:32:51.666873+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T13:32:51.666873+0000","last_undegraded":"2024-01-27T13:32:51.666873+0000","last_fullsized":"2024-01-27T13:32:51.666873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669933+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:32:51.669933+0000","last_peered":"2024-01-27T13:32:51.669933+0000","last_clean":"2024-01-27T13:32:51.669933+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:32:51.669933+0000","last_undegraded":"2024-01-27T13:32:51.669933+0000","last_fullsized":"2024-01-27T13:32:51.669933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672503+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T13:32:51.672503+0000","last_peered":"2024-01-27T13:32:51.672503+0000","last_clean":"2024-01-27T13:32:51.672503+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T13:32:51.672503+0000","last_undegraded":"2024-01-27T13:32:51.672503+0000","last_fullsized":"2024-01-27T13:32:51.672503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663177+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T13:32:51.663177+0000","last_peered":"2024-01-27T13:32:51.663177+0000","last_clean":"2024-01-27T13:32:51.663177+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T13:32:51.663177+0000","last_undegraded":"2024-01-27T13:32:51.663177+0000","last_fullsized":"2024-01-27T13:32:51.663177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705477+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T13:32:51.705477+0000","last_peered":"2024-01-27T13:32:51.705477+0000","last_clean":"2024-01-27T13:32:51.705477+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T13:32:51.705477+0000","last_undegraded":"2024-01-27T13:32:51.705477+0000","last_fullsized":"2024-01-27T13:32:51.705477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666618+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T13:32:51.666618+0000","last_peered":"2024-01-27T13:32:51.666618+0000","last_clean":"2024-01-27T13:32:51.666618+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T13:32:51.666618+0000","last_undegraded":"2024-01-27T13:32:51.666618+0000","last_fullsized":"2024-01-27T13:32:51.666618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671614+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T13:32:51.671614+0000","last_peered":"2024-01-27T13:32:51.671614+0000","last_clean":"2024-01-27T13:32:51.671614+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T13:32:51.671614+0000","last_undegraded":"2024-01-27T13:32:51.671614+0000","last_fullsized":"2024-01-27T13:32:51.671614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.714082+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T13:32:51.714082+0000","last_peered":"2024-01-27T13:32:51.714082+0000","last_clean":"2024-01-27T13:32:51.714082+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T13:32:51.714082+0000","last_undegraded":"2024-01-27T13:32:51.714082+0000","last_fullsized":"2024-01-27T13:32:51.714082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673178+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T13:32:51.673178+0000","last_peered":"2024-01-27T13:32:51.673178+0000","last_clean":"2024-01-27T13:32:51.673178+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T13:32:51.673178+0000","last_undegraded":"2024-01-27T13:32:51.673178+0000","last_fullsized":"2024-01-27T13:32:51.673178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.671452+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T13:32:51.671452+0000","last_peered":"2024-01-27T13:32:51.671452+0000","last_clean":"2024-01-27T13:32:51.671452+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T13:32:51.671452+0000","last_undegraded":"2024-01-27T13:32:51.671452+0000","last_fullsized":"2024-01-27T13:32:51.671452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705145+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T13:32:51.705145+0000","last_peered":"2024-01-27T13:32:51.705145+0000","last_clean":"2024-01-27T13:32:51.705145+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T13:32:51.705145+0000","last_undegraded":"2024-01-27T13:32:51.705145+0000","last_fullsized":"2024-01-27T13:32:51.705145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669744+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T13:32:51.669744+0000","last_peered":"2024-01-27T13:32:51.669744+0000","last_clean":"2024-01-27T13:32:51.669744+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T13:32:51.669744+0000","last_undegraded":"2024-01-27T13:32:51.669744+0000","last_fullsized":"2024-01-27T13:32:51.669744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705388+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T13:32:51.705388+0000","last_peered":"2024-01-27T13:32:51.705388+0000","last_clean":"2024-01-27T13:32:51.705388+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T13:32:51.705388+0000","last_undegraded":"2024-01-27T13:32:51.705388+0000","last_fullsized":"2024-01-27T13:32:51.705388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666446+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T13:32:51.666446+0000","last_peered":"2024-01-27T13:32:51.666446+0000","last_clean":"2024-01-27T13:32:51.666446+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T13:32:51.666446+0000","last_undegraded":"2024-01-27T13:32:51.666446+0000","last_fullsized":"2024-01-27T13:32:51.666446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672959+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T13:32:51.672959+0000","last_peered":"2024-01-27T13:32:51.672959+0000","last_clean":"2024-01-27T13:32:51.672959+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T13:32:51.672959+0000","last_undegraded":"2024-01-27T13:32:51.672959+0000","last_fullsized":"2024-01-27T13:32:51.672959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.660006+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T13:32:51.660006+0000","last_peered":"2024-01-27T13:32:51.660006+0000","last_clean":"2024-01-27T13:32:51.660006+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T13:32:51.660006+0000","last_undegraded":"2024-01-27T13:32:51.660006+0000","last_fullsized":"2024-01-27T13:32:51.660006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.663167+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T13:32:51.663167+0000","last_peered":"2024-01-27T13:32:51.663167+0000","last_clean":"2024-01-27T13:32:51.663167+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T13:32:51.663167+0000","last_undegraded":"2024-01-27T13:32:51.663167+0000","last_fullsized":"2024-01-27T13:32:51.663167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705393+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T13:32:51.705393+0000","last_peered":"2024-01-27T13:32:51.705393+0000","last_clean":"2024-01-27T13:32:51.705393+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T13:32:51.705393+0000","last_undegraded":"2024-01-27T13:32:51.705393+0000","last_fullsized":"2024-01-27T13:32:51.705393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705064+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T13:32:51.705064+0000","last_peered":"2024-01-27T13:32:51.705064+0000","last_clean":"2024-01-27T13:32:51.705064+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T13:32:51.705064+0000","last_undegraded":"2024-01-27T13:32:51.705064+0000","last_fullsized":"2024-01-27T13:32:51.705064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.706926+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T13:32:51.706926+0000","last_peered":"2024-01-27T13:32:51.706926+0000","last_clean":"2024-01-27T13:32:51.706926+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T13:32:51.706926+0000","last_undegraded":"2024-01-27T13:32:51.706926+0000","last_fullsized":"2024-01-27T13:32:51.706926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.666058+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T13:32:51.666058+0000","last_peered":"2024-01-27T13:32:51.666058+0000","last_clean":"2024-01-27T13:32:51.666058+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T13:32:51.666058+0000","last_undegraded":"2024-01-27T13:32:51.666058+0000","last_fullsized":"2024-01-27T13:32:51.666058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.669457+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T13:32:51.669457+0000","last_peered":"2024-01-27T13:32:51.669457+0000","last_clean":"2024-01-27T13:32:51.669457+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T13:32:51.669457+0000","last_undegraded":"2024-01-27T13:32:51.669457+0000","last_fullsized":"2024-01-27T13:32:51.669457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667059+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T13:32:51.667059+0000","last_peered":"2024-01-27T13:32:51.667059+0000","last_clean":"2024-01-27T13:32:51.667059+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T13:32:51.667059+0000","last_undegraded":"2024-01-27T13:32:51.667059+0000","last_fullsized":"2024-01-27T13:32:51.667059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673060+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T13:32:51.673060+0000","last_peered":"2024-01-27T13:32:51.673060+0000","last_clean":"2024-01-27T13:32:51.673060+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T13:32:51.673060+0000","last_undegraded":"2024-01-27T13:32:51.673060+0000","last_fullsized":"2024-01-27T13:32:51.673060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.673088+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T13:32:51.673088+0000","last_peered":"2024-01-27T13:32:51.673088+0000","last_clean":"2024-01-27T13:32:51.673088+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T13:32:51.673088+0000","last_undegraded":"2024-01-27T13:32:51.673088+0000","last_fullsized":"2024-01-27T13:32:51.673088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.706601+0000","last_change":"2024-01-27T13:32:51.706601+0000","last_active":"2024-01-27T13:32:51.706601+0000","last_peered":"2024-01-27T13:32:51.706601+0000","last_clean":"2024-01-27T13:32:51.706601+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T13:32:51.706601+0000","last_undegraded":"2024-01-27T13:32:51.706601+0000","last_fullsized":"2024-01-27T13:32:51.706601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.672083+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T13:32:51.672083+0000","last_peered":"2024-01-27T13:32:51.672083+0000","last_clean":"2024-01-27T13:32:51.672083+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T13:32:51.672083+0000","last_undegraded":"2024-01-27T13:32:51.672083+0000","last_fullsized":"2024-01-27T13:32:51.672083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659380+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T13:32:51.659380+0000","last_peered":"2024-01-27T13:32:51.659380+0000","last_clean":"2024-01-27T13:32:51.659380+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T13:32:51.659380+0000","last_undegraded":"2024-01-27T13:32:51.659380+0000","last_fullsized":"2024-01-27T13:32:51.659380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705301+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T13:32:51.705301+0000","last_peered":"2024-01-27T13:32:51.705301+0000","last_clean":"2024-01-27T13:32:51.705301+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T13:32:51.705301+0000","last_undegraded":"2024-01-27T13:32:51.705301+0000","last_fullsized":"2024-01-27T13:32:51.705301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659458+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T13:32:51.659458+0000","last_peered":"2024-01-27T13:32:51.659458+0000","last_clean":"2024-01-27T13:32:51.659458+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T13:32:51.659458+0000","last_undegraded":"2024-01-27T13:32:51.659458+0000","last_fullsized":"2024-01-27T13:32:51.659458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.705392+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T13:32:51.705392+0000","last_peered":"2024-01-27T13:32:51.705392+0000","last_clean":"2024-01-27T13:32:51.705392+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T13:32:51.705392+0000","last_undegraded":"2024-01-27T13:32:51.705392+0000","last_fullsized":"2024-01-27T13:32:51.705392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.667214+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T13:32:51.667214+0000","last_peered":"2024-01-27T13:32:51.667214+0000","last_clean":"2024-01-27T13:32:51.667214+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T13:32:51.667214+0000","last_undegraded":"2024-01-27T13:32:51.667214+0000","last_fullsized":"2024-01-27T13:32:51.667214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.708500+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T13:32:51.708500+0000","last_peered":"2024-01-27T13:32:51.708500+0000","last_clean":"2024-01-27T13:32:51.708500+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T13:32:51.708500+0000","last_undegraded":"2024-01-27T13:32:51.708500+0000","last_fullsized":"2024-01-27T13:32:51.708500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:32:51.659831+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T13:32:51.659831+0000","last_peered":"2024-01-27T13:32:51.659831+0000","last_clean":"2024-01-27T13:32:51.659831+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T13:32:51.659831+0000","last_undegraded":"2024-01-27T13:32:51.659831+0000","last_fullsized":"2024-01-27T13:32:51.659831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":294912,"data_stored":120115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":282624,"data_stored":116274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":290816,"data_stored":116434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":707224,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":120115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6179999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":360448,"data_stored":707280,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T13:32:57.529 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-27T13:32:57.529 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-27T13:32:57.530 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-27T13:32:57.530 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-27T13:32:57.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.675+0000 7f271297c640 1 Processor -- start 2024-01-27T13:32:57.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.675+0000 7f271297c640 1 -- start start 2024-01-27T13:32:57.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f271297c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f270c1598e0 0x7f270c0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f271297c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f270c0c8010 0x7f270c06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f271297c640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270c0c7620 con 0x7f270c153b80 2024-01-27T13:32:57.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f271297c640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270c0c67b0 con 0x7f270c1598e0 2024-01-27T13:32:57.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f271297c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270c0ca180 con 0x7f270c0c8010 2024-01-27T13:32:57.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f270b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f270c1598e0 0x7f270c0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.676+0000 7f2710f19640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f270c0c8010 0x7f270c06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.677+0000 7f270bfff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f270c153b80 0x7f270c0c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47100/0 (socket says 172.21.15.46:47100) 2024-01-27T13:32:57.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.677+0000 7f270bfff640 1 -- 172.21.15.46:0/3865437725 learned_addr learned my addr 172.21.15.46:0/3865437725 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:32:57.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.679+0000 7f2710f19640 1 -- 172.21.15.46:0/3865437725 >> v2:172.21.15.46:3300/0 conn(0x7f270c1598e0 msgr2=0x7f270c0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:57.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.679+0000 7f2710f19640 1 --2- 172.21.15.46:0/3865437725 >> v2:172.21.15.46:3300/0 conn(0x7f270c1598e0 0x7f270c0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.679+0000 7f2710f19640 1 -- 172.21.15.46:0/3865437725 >> v1:172.21.15.46:6789/0 conn(0x7f270c153b80 legacy=0x7f270c0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.679+0000 7f2710f19640 1 -- 172.21.15.46:0/3865437725 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c0ca460 con 0x7f270c0c8010 2024-01-27T13:32:57.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.681+0000 7f2710f19640 1 --2- 172.21.15.46:0/3865437725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c0c8010 0x7f270c06ba60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f270c08c900 tx=0x7f270402be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd05007672b238f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:57.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.684+0000 7f270affd640 1 -- 172.21.15.46:0/3865437725 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270402cbf0 con 0x7f270c0c8010 2024-01-27T13:32:57.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.684+0000 7f270affd640 1 -- 172.21.15.46:0/3865437725 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270402cd50 con 0x7f270c0c8010 2024-01-27T13:32:57.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.684+0000 7f270affd640 1 -- 172.21.15.46:0/3865437725 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704034660 con 0x7f270c0c8010 2024-01-27T13:32:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 -- 172.21.15.46:0/3865437725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c0c8010 msgr2=0x7f270c06ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 --2- 172.21.15.46:0/3865437725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c0c8010 0x7f270c06ba60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f270c08c900 tx=0x7f270402be40 comp rx=0 tx=0).stop 2024-01-27T13:32:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 -- 172.21.15.46:0/3865437725 shutdown_connections 2024-01-27T13:32:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 --2- 172.21.15.46:0/3865437725 >> v2:172.21.15.46:3300/0 conn(0x7f270c1598e0 0x7f270c0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 --2- 172.21.15.46:0/3865437725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c0c8010 0x7f270c06ba60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 -- 172.21.15.46:0/3865437725 >> 172.21.15.46:0/3865437725 conn(0x7f270c0cf230 msgr2=0x7f270c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 -- 172.21.15.46:0/3865437725 shutdown_connections 2024-01-27T13:32:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.685+0000 7f271297c640 1 -- 172.21.15.46:0/3865437725 wait complete. 2024-01-27T13:32:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.686+0000 7f271297c640 1 Processor -- start 2024-01-27T13:32:57.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 -- start start 2024-01-27T13:32:57.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 0x7f270c14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c153b80 0x7f270c0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f270c1598e0 0x7f270c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c14c3c0 con 0x7f270c0c8010 2024-01-27T13:32:57.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c14da60 con 0x7f270c153b80 2024-01-27T13:32:57.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.687+0000 7f271297c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c14eb90 con 0x7f270c1598e0 2024-01-27T13:32:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.688+0000 7f270bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 0x7f270c14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.688+0000 7f270bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 0x7f270c14ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50044/0 (socket says 172.21.15.46:50044) 2024-01-27T13:32:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.688+0000 7f270bfff640 1 -- 172.21.15.46:0/3341908432 learned_addr learned my addr 172.21.15.46:0/3341908432 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.688+0000 7f270b7fe640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c153b80 0x7f270c0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.688+0000 7f2710f19640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f270c1598e0 0x7f270c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.692+0000 7f270b7fe640 1 -- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f270c1598e0 msgr2=0x7f270c0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.692+0000 7f270b7fe640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f270c1598e0 0x7f270c0c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.692+0000 7f270b7fe640 1 -- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 msgr2=0x7f270c14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:57.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.692+0000 7f270b7fe640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 0x7f270c14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:57.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.692+0000 7f270b7fe640 1 -- 172.21.15.46:0/3341908432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009a70 con 0x7f270c153b80 2024-01-27T13:32:57.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.692+0000 7f270bfff640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 0x7f270c14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:57.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.694+0000 7f270b7fe640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c153b80 0x7f270c0c4fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00e870 tx=0x7f26fc00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.697+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00ee60 con 0x7f270c153b80 2024-01-27T13:32:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.697+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00c940 con 0x7f270c153b80 2024-01-27T13:32:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.697+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00ccd0 con 0x7f270c153b80 2024-01-27T13:32:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.697+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c14ee30 con 0x7f270c153b80 2024-01-27T13:32:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.698+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c14f3f0 con 0x7f270c153b80 2024-01-27T13:32:57.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.698+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c067ca0 con 0x7f270c153b80 2024-01-27T13:32:57.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.942+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f26fc013470 con 0x7f270c153b80 2024-01-27T13:32:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.942+0000 7f2708ff9640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f26f806af20 0x7f26f806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.942+0000 7f270bfff640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f26f806af20 0x7f26f806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:57.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.943+0000 7f270bfff640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f26f806af20 0x7f26f806d3e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2700004e60 tx=0x7f2700007f10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:57.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.945+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26fc00ce30 con 0x7f270c153b80 2024-01-27T13:32:57.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:57.956+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f26fc054d70 con 0x7f270c153b80 2024-01-27T13:32:58.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.201+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f270c074410 con 0x7f270c153b80 2024-01-27T13:32:58.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.207+0000 7f2708ff9640 1 -- 172.21.15.46:0/3341908432 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f26fc017080 con 0x7f270c153b80 2024-01-27T13:32:58.200 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:58.200 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f26f806af20 msgr2=0x7f26f806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f26f806af20 0x7f26f806d3e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2700004e60 tx=0x7f2700007f10 comp rx=0 tx=0).stop 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c153b80 msgr2=0x7f270c0c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c153b80 0x7f270c0c4fe0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00e870 tx=0x7f26fc00ed30 comp rx=0 tx=0).stop 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 shutdown_connections 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f26f806af20 0x7f26f806d3e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f270c1598e0 0x7f270c0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f270c153b80 0x7f270c0c4fe0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 --2- 172.21.15.46:0/3341908432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f270c0c8010 0x7f270c14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 >> 172.21.15.46:0/3341908432 conn(0x7f270c0cf230 msgr2=0x7f270c0cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:58.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 shutdown_connections 2024-01-27T13:32:58.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.209+0000 7f271297c640 1 -- 172.21.15.46:0/3341908432 wait complete. 2024-01-27T13:32:58.212 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-27T13:32:58.213 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:32:58.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 Processor -- start 2024-01-27T13:32:58.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 -- start start 2024-01-27T13:32:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80c00c8f00 0x7f80c00cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80c00c92e0 0x7f80c00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c015cf00 0x7f80c015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00cc9c0 con 0x7f80c00c8f00 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00ca9f0 con 0x7f80c00c92e0 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.322+0000 7f80c6ae5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0159d50 con 0x7f80c015cf00 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.323+0000 7f80c5082640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c015cf00 0x7f80c015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.323+0000 7f80c4881640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80c00c8f00 0x7f80c00cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.323+0000 7f80bffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80c00c92e0 0x7f80c00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.323+0000 7f80c4881640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80c00c8f00 0x7f80c00cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50058/0 (socket says 172.21.15.46:50058) 2024-01-27T13:32:58.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.323+0000 7f80c4881640 1 -- 172.21.15.46:0/2911868261 learned_addr learned my addr 172.21.15.46:0/2911868261 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.325+0000 7f80bffff640 1 -- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c015cf00 msgr2=0x7f80c015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.325+0000 7f80bffff640 1 --2- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c015cf00 0x7f80c015d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.325+0000 7f80bffff640 1 -- 172.21.15.46:0/2911868261 >> v2:172.21.15.46:3300/0 conn(0x7f80c00c8f00 msgr2=0x7f80c00cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.325+0000 7f80bffff640 1 --2- 172.21.15.46:0/2911868261 >> v2:172.21.15.46:3300/0 conn(0x7f80c00c8f00 0x7f80c00cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.325+0000 7f80bffff640 1 -- 172.21.15.46:0/2911868261 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00cc6e0 con 0x7f80c00c92e0 2024-01-27T13:32:58.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.327+0000 7f80bffff640 1 --2- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c92e0 0x7f80c00cf550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f80c008bb10 tx=0x7f80b402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4846e20daa2b9123 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:58.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.329+0000 7f80bf7fe640 1 -- 172.21.15.46:0/2911868261 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031830 con 0x7f80c00c92e0 2024-01-27T13:32:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.331+0000 7f80bf7fe640 1 -- 172.21.15.46:0/2911868261 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4031990 con 0x7f80c00c92e0 2024-01-27T13:32:58.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.331+0000 7f80bf7fe640 1 -- 172.21.15.46:0/2911868261 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031d20 con 0x7f80c00c92e0 2024-01-27T13:32:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 -- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c92e0 msgr2=0x7f80c00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c92e0 0x7f80c00cf550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f80c008bb10 tx=0x7f80b402b8d0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 -- 172.21.15.46:0/2911868261 shutdown_connections 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c015cf00 0x7f80c015d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/2911868261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c92e0 0x7f80c00cf550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/2911868261 >> v2:172.21.15.46:3300/0 conn(0x7f80c00c8f00 0x7f80c00cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 -- 172.21.15.46:0/2911868261 >> 172.21.15.46:0/2911868261 conn(0x7f80c008afd0 msgr2=0x7f80c008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 -- 172.21.15.46:0/2911868261 shutdown_connections 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.332+0000 7f80c6ae5640 1 -- 172.21.15.46:0/2911868261 wait complete. 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.333+0000 7f80c6ae5640 1 Processor -- start 2024-01-27T13:32:58.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.333+0000 7f80c6ae5640 1 -- start start 2024-01-27T13:32:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c6ae5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c8f00 0x7f80c014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c6ae5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c00c92e0 0x7f80c00cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c6ae5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80c015cf00 0x7f80c01eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c6ae5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014dcb0 con 0x7f80c015cf00 2024-01-27T13:32:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c6ae5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014d7d0 con 0x7f80c00c8f00 2024-01-27T13:32:58.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c6ae5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01f2260 con 0x7f80c00c92e0 2024-01-27T13:32:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c5082640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80c015cf00 0x7f80c01eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.334+0000 7f80c4881640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c8f00 0x7f80c014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.335+0000 7f80bffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c00c92e0 0x7f80c00cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.335+0000 7f80c5082640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80c015cf00 0x7f80c01eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50066/0 (socket says 172.21.15.46:50066) 2024-01-27T13:32:58.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.335+0000 7f80c5082640 1 -- 172.21.15.46:0/4265638873 learned_addr learned my addr 172.21.15.46:0/4265638873 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.338+0000 7f80c4881640 1 -- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c00c92e0 msgr2=0x7f80c00cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.338+0000 7f80c4881640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c00c92e0 0x7f80c00cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.338+0000 7f80c4881640 1 -- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80c015cf00 msgr2=0x7f80c01eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.338+0000 7f80c4881640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80c015cf00 0x7f80c01eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.338+0000 7f80c4881640 1 -- 172.21.15.46:0/4265638873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009400 con 0x7f80c00c8f00 2024-01-27T13:32:58.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.340+0000 7f80c4881640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c8f00 0x7f80c014d290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80b000e830 tx=0x7f80b000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.344+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000c940 con 0x7f80c00c8f00 2024-01-27T13:32:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.344+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000caa0 con 0x7f80c00c8f00 2024-01-27T13:32:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.344+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000ce30 con 0x7f80c00c8f00 2024-01-27T13:32:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.344+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c014d9d0 con 0x7f80c00c8f00 2024-01-27T13:32:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.344+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c01f2790 con 0x7f80c00c8f00 2024-01-27T13:32:58.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.345+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0074410 con 0x7f80c00c8f00 2024-01-27T13:32:58.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.363+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f80b0013470 con 0x7f80c00c8f00 2024-01-27T13:32:58.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.363+0000 7f80bd7fa640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f80ac06aed0 0x7f80ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.363+0000 7f80bffff640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f80ac06aed0 0x7f80ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.363+0000 7f80bffff640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f80ac06aed0 0x7f80ac06d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80b4036000 tx=0x7f80b403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:58.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.366+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f80b0058ba0 con 0x7f80c00c8f00 2024-01-27T13:32:58.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:32:58.382 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:32:58.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.606+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f80b0054ee0 con 0x7f80c00c8f00 2024-01-27T13:32:58.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.792+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c00c5f20 con 0x7f80c00c8f00 2024-01-27T13:32:58.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.831+0000 7f80bd7fa640 1 -- 172.21.15.46:0/4265638873 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f80b0021020 con 0x7f80c00c8f00 2024-01-27T13:32:58.824 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:32:58.824 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:32:58.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f80ac06aed0 msgr2=0x7f80ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f80ac06aed0 0x7f80ac06d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80b4036000 tx=0x7f80b403c040 comp rx=0 tx=0).stop 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c8f00 msgr2=0x7f80c014d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c8f00 0x7f80c014d290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f80b000e830 tx=0x7f80b000ecf0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 shutdown_connections 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f80ac06aed0 0x7f80ac06d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80c015cf00 0x7f80c01eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80c00c92e0 0x7f80c00cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 --2- 172.21.15.46:0/4265638873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80c00c8f00 0x7f80c014d290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 >> 172.21.15.46:0/4265638873 conn(0x7f80c008afd0 msgr2=0x7f80c014c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 shutdown_connections 2024-01-27T13:32:58.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.833+0000 7f80c6ae5640 1 -- 172.21.15.46:0/4265638873 wait complete. 2024-01-27T13:32:58.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T13:32:10.212389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T13:32:11.933652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T13:32:15.934129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T13:32:58.838 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:32:58.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.952+0000 7f333c01e640 1 Processor -- start 2024-01-27T13:32:58.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.952+0000 7f333c01e640 1 -- start start 2024-01-27T13:32:58.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f333c01e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f333c01e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33340c77d0 0x7f33340c8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f333c01e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33340c8580 0x7f3334159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f333c01e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340c9740 con 0x7f33340c77d0 2024-01-27T13:32:58.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f333c01e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33340c9480 con 0x7f33340c8580 2024-01-27T13:32:58.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f333c01e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333406bfb0 con 0x7f3334153a50 2024-01-27T13:32:58.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.953+0000 7f33395b9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33340c77d0 0x7f33340c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.954+0000 7f333a5bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f33340c8580 0x7f3334159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.954+0000 7f33395b9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f33340c77d0 0x7f33340c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50082/0 (socket says 172.21.15.46:50082) 2024-01-27T13:32:58.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.954+0000 7f3339dba640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.954+0000 7f33395b9640 1 -- 172.21.15.46:0/2901371958 learned_addr learned my addr 172.21.15.46:0/2901371958 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:58.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.956+0000 7f33395b9640 1 -- 172.21.15.46:0/2901371958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 msgr2=0x7f33340c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:58.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.956+0000 7f33395b9640 1 --2- 172.21.15.46:0/2901371958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.956+0000 7f33395b9640 1 -- 172.21.15.46:0/2901371958 >> v2:172.21.15.78:3300/0 conn(0x7f33340c8580 msgr2=0x7f3334159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:58.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.956+0000 7f33395b9640 1 --2- 172.21.15.46:0/2901371958 >> v2:172.21.15.78:3300/0 conn(0x7f33340c8580 0x7f3334159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.956+0000 7f33395b9640 1 -- 172.21.15.46:0/2901371958 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333406c290 con 0x7f33340c77d0 2024-01-27T13:32:58.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.958+0000 7f33395b9640 1 --2- 172.21.15.46:0/2901371958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 0x7f33340c8040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3334157420 tx=0x7f332402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1731cb6931f0ed server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:58.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f3338db8640 1 -- 172.21.15.46:0/2901371958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324030860 con 0x7f33340c77d0 2024-01-27T13:32:58.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f3338db8640 1 -- 172.21.15.46:0/2901371958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33240309c0 con 0x7f33340c77d0 2024-01-27T13:32:58.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f3338db8640 1 -- 172.21.15.46:0/2901371958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324030d50 con 0x7f33340c77d0 2024-01-27T13:32:58.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 -- 172.21.15.46:0/2901371958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 msgr2=0x7f33340c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 --2- 172.21.15.46:0/2901371958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 0x7f33340c8040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3334157420 tx=0x7f332402b9a0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 -- 172.21.15.46:0/2901371958 shutdown_connections 2024-01-27T13:32:58.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 --2- 172.21.15.46:0/2901371958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 0x7f33340c8040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 --2- 172.21.15.46:0/2901371958 >> v2:172.21.15.78:3300/0 conn(0x7f33340c8580 0x7f3334159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 --2- 172.21.15.46:0/2901371958 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.962+0000 7f333c01e640 1 -- 172.21.15.46:0/2901371958 >> 172.21.15.46:0/2901371958 conn(0x7f333406efe0 msgr2=0x7f333406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:58.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.963+0000 7f333c01e640 1 -- 172.21.15.46:0/2901371958 shutdown_connections 2024-01-27T13:32:58.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.963+0000 7f333c01e640 1 -- 172.21.15.46:0/2901371958 wait complete. 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.964+0000 7f333c01e640 1 Processor -- start 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.964+0000 7f333c01e640 1 -- start start 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.964+0000 7f333c01e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 0x7f33341efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.964+0000 7f333c01e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 0x7f3334152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.964+0000 7f333c01e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.964+0000 7f333c01e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340cd350 con 0x7f33340c77d0 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f333c01e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33340c6380 con 0x7f33340c8580 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f333c01e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33340cc600 con 0x7f3334153a50 2024-01-27T13:32:58.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f333a5bb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f33395b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 0x7f3334152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f333a5bb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43010/0 (socket says 172.21.15.46:43010) 2024-01-27T13:32:58.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f33395b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 0x7f3334152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:42554/0 (socket says 172.21.15.46:42554) 2024-01-27T13:32:58.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.965+0000 7f333a5bb640 1 -- 172.21.15.46:0/3957784792 learned_addr learned my addr 172.21.15.46:0/3957784792 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.968+0000 7f333a5bb640 1 -- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 msgr2=0x7f3334152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.968+0000 7f333a5bb640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 0x7f3334152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.968+0000 7f333a5bb640 1 -- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 msgr2=0x7f33341efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.968+0000 7f333a5bb640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 0x7f33341efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.968+0000 7f333a5bb640 1 -- 172.21.15.46:0/3957784792 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33240094d0 con 0x7f3334153a50 2024-01-27T13:32:58.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.968+0000 7f33395b9640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 0x7f3334152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:32:58.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.971+0000 7f333a5bb640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340cb3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f332c00eed0 tx=0x7f332c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:58.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.978+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c010040 con 0x7f3334153a50 2024-01-27T13:32:58.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.978+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c014400 con 0x7f3334153a50 2024-01-27T13:32:58.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.978+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c009ea0 con 0x7f3334153a50 2024-01-27T13:32:58.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.978+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33341effc0 con 0x7f3334153a50 2024-01-27T13:32:58.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.978+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33340caf40 con 0x7f3334153a50 2024-01-27T13:32:58.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:58.979+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33340cad70 con 0x7f3334153a50 2024-01-27T13:32:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.006+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f332c0147b0 con 0x7f3334153a50 2024-01-27T13:32:58.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.006+0000 7f332a7fc640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f331806af20 0x7f331806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:58.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.007+0000 7f3339dba640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f331806af20 0x7f331806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:58.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.007+0000 7f3339dba640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f331806af20 0x7f331806d3e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3330006a90 tx=0x7f3330006a20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:59.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.011+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f332c059610 con 0x7f3334153a50 2024-01-27T13:32:59.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.255+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f332c055250 con 0x7f3334153a50 2024-01-27T13:32:59.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.437+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33341effc0 con 0x7f3334153a50 2024-01-27T13:32:59.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.441+0000 7f332a7fc640 1 -- 172.21.15.46:0/3957784792 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33341effc0 con 0x7f3334153a50 2024-01-27T13:32:59.433 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:32:59.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f331806af20 msgr2=0x7f331806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f331806af20 0x7f331806d3e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3330006a90 tx=0x7f3330006a20 comp rx=0 tx=0).stop 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 msgr2=0x7f33340cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340cb3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f332c00eed0 tx=0x7f332c00b480 comp rx=0 tx=0).stop 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 shutdown_connections 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f331806af20 0x7f331806d3e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f3334153a50 0x7f33340cb3d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33340c8580 0x7f3334152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 --2- 172.21.15.46:0/3957784792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f33340c77d0 0x7f33341efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 >> 172.21.15.46:0/3957784792 conn(0x7f333406efe0 msgr2=0x7f3334070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 shutdown_connections 2024-01-27T13:32:59.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.443+0000 7f333c01e640 1 -- 172.21.15.46:0/3957784792 wait complete. 2024-01-27T13:32:59.447 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T13:32:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 Processor -- start 2024-01-27T13:32:59.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 -- start start 2024-01-27T13:32:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 0x7f4e5c0725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e5c071140 0x7f4e5c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5c157630 con 0x7f4e5c071ff0 2024-01-27T13:32:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5c0c2420 con 0x7f4e5c071140 2024-01-27T13:32:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.560+0000 7f4e6107c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c158520 con 0x7f4e5c151aa0 2024-01-27T13:32:59.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.561+0000 7f4e5ad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 0x7f4e5c0725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.561+0000 7f4e53fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4e5c071140 0x7f4e5c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.562+0000 7f4e5ad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 0x7f4e5c0725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43016/0 (socket says 172.21.15.46:43016) 2024-01-27T13:32:59.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.562+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/727700528 learned_addr learned my addr 172.21.15.46:0/727700528 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.564+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/727700528 >> v2:172.21.15.78:3300/0 conn(0x7f4e5c071140 msgr2=0x7f4e5c071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:32:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.564+0000 7f4e5ad9d640 1 --2- 172.21.15.46:0/727700528 >> v2:172.21.15.78:3300/0 conn(0x7f4e5c071140 0x7f4e5c071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.564+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/727700528 >> v1:172.21.15.78:6789/0 conn(0x7f4e5c071ff0 legacy=0x7f4e5c15ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:59.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.564+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/727700528 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c157910 con 0x7f4e5c151aa0 2024-01-27T13:32:59.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.566+0000 7f4e5ad9d640 1 --2- 172.21.15.46:0/727700528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 0x7f4e5c0725f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009870 tx=0x7f4e4c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36444e7ba3e89d29 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e5a59c640 1 -- 172.21.15.46:0/727700528 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c030840 con 0x7f4e5c151aa0 2024-01-27T13:32:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e5a59c640 1 -- 172.21.15.46:0/727700528 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c0309a0 con 0x7f4e5c151aa0 2024-01-27T13:32:59.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e5a59c640 1 -- 172.21.15.46:0/727700528 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c030d30 con 0x7f4e5c151aa0 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 -- 172.21.15.46:0/727700528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 msgr2=0x7f4e5c0725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 --2- 172.21.15.46:0/727700528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 0x7f4e5c0725f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009870 tx=0x7f4e4c02b980 comp rx=0 tx=0).stop 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 -- 172.21.15.46:0/727700528 shutdown_connections 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 --2- 172.21.15.46:0/727700528 >> v2:172.21.15.78:3300/0 conn(0x7f4e5c071140 0x7f4e5c071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 --2- 172.21.15.46:0/727700528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c151aa0 0x7f4e5c0725f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 -- 172.21.15.46:0/727700528 >> 172.21.15.46:0/727700528 conn(0x7f4e5c0cae90 msgr2=0x7f4e5c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 -- 172.21.15.46:0/727700528 shutdown_connections 2024-01-27T13:32:59.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.570+0000 7f4e6107c640 1 -- 172.21.15.46:0/727700528 wait complete. 2024-01-27T13:32:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 Processor -- start 2024-01-27T13:32:59.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 -- start start 2024-01-27T13:32:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c071140 0x7f4e5c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c071ff0 0x7f4e5c1f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e5c14c730 0x7f4e5c149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c14a500 con 0x7f4e5c14c730 2024-01-27T13:32:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1f0000 con 0x7f4e5c071140 2024-01-27T13:32:59.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.572+0000 7f4e6107c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c14a730 con 0x7f4e5c071ff0 2024-01-27T13:32:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.573+0000 7f4e5b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e5c14c730 0x7f4e5c149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.573+0000 7f4e5b59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e5c14c730 0x7f4e5c149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50096/0 (socket says 172.21.15.46:50096) 2024-01-27T13:32:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.573+0000 7f4e5b59e640 1 -- 172.21.15.46:0/2406229445 learned_addr learned my addr 172.21.15.46:0/2406229445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:32:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.573+0000 7f4e5ad9d640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c071140 0x7f4e5c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:59.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.573+0000 7f4e53fff640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c071ff0 0x7f4e5c1f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.577+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c071ff0 msgr2=0x7f4e5c1f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.577+0000 7f4e5ad9d640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c071ff0 0x7f4e5c1f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.577+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e5c14c730 msgr2=0x7f4e5c149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:32:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.577+0000 7f4e5ad9d640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e5c14c730 0x7f4e5c149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:32:59.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.577+0000 7f4e5ad9d640 1 -- 172.21.15.46:0/2406229445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0094d0 con 0x7f4e5c071140 2024-01-27T13:32:59.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.579+0000 7f4e5ad9d640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c071140 0x7f4e5c159df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c033000 tx=0x7f4e4c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.583+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c039a10 con 0x7f4e5c071140 2024-01-27T13:32:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.583+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c039b70 con 0x7f4e5c071140 2024-01-27T13:32:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.583+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c043410 con 0x7f4e5c071140 2024-01-27T13:32:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.583+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c14cdf0 con 0x7f4e5c071140 2024-01-27T13:32:59.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.583+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c1f0270 con 0x7f4e5c071140 2024-01-27T13:32:59.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.584+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c066e30 con 0x7f4e5c071140 2024-01-27T13:32:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.826+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4e4c04c3b0 con 0x7f4e5c071140 2024-01-27T13:32:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.826+0000 7f4e537fe640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4e3c06af20 0x7f4e3c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:32:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.827+0000 7f4e53fff640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4e3c06af20 0x7f4e3c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:32:59.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.827+0000 7f4e53fff640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4e3c06af20 0x7f4e3c06d3e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c1e49e0 tx=0x7f4e44009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:32:59.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.829+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e4c07ac70 con 0x7f4e5c071140 2024-01-27T13:32:59.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:32:59.839+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4e4c076fb0 con 0x7f4e5c071140 2024-01-27T13:33:00.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.023+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e5c0c4710 con 0x7f4e5c071140 2024-01-27T13:33:00.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.120+0000 7f4e537fe640 1 -- 172.21.15.46:0/2406229445 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e4c034020 con 0x7f4e5c071140 2024-01-27T13:33:00.112 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4e3c06af20 msgr2=0x7f4e3c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4e3c06af20 0x7f4e3c06d3e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c1e49e0 tx=0x7f4e44009190 comp rx=0 tx=0).stop 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c071140 msgr2=0x7f4e5c159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c071140 0x7f4e5c159df0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c033000 tx=0x7f4e4c004730 comp rx=0 tx=0).stop 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 shutdown_connections 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4e3c06af20 0x7f4e3c06d3e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e5c14c730 0x7f4e5c149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4e5c071ff0 0x7f4e5c1f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 --2- 172.21.15.46:0/2406229445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e5c071140 0x7f4e5c159df0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 >> 172.21.15.46:0/2406229445 conn(0x7f4e5c0cae90 msgr2=0x7f4e5c15ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 shutdown_connections 2024-01-27T13:33:00.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.122+0000 7f4e6107c640 1 -- 172.21.15.46:0/2406229445 wait complete. 2024-01-27T13:33:00.126 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T13:33:00.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.239+0000 7f15b0943640 1 Processor -- start 2024-01-27T13:33:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.239+0000 7f15b0943640 1 -- start start 2024-01-27T13:33:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.240+0000 7f15b0943640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.240+0000 7f15b0943640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac158550 con 0x7f15ac0cce20 2024-01-27T13:33:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.240+0000 7f15b0943640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac15ab00 con 0x7f15ac0c9130 2024-01-27T13:33:00.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.240+0000 7f15b0943640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15bb10 con 0x7f15ac151a10 2024-01-27T13:33:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.240+0000 7f15aad9d640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f15ac0cce20 0x7f15ac161e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47104/0 (socket says 172.21.15.46:47104) 2024-01-27T13:33:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.240+0000 7f15aad9d640 1 -- 172.21.15.46:0/3888251785 learned_addr learned my addr 172.21.15.46:0/3888251785 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:00.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.241+0000 7f15aa59c640 1 --2- 172.21.15.46:0/3888251785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.243+0000 7f15a959a640 1 -- 172.21.15.46:0/3888251785 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795493733 0 0) 0x7f159c001490 con 0x7f15ac0cce20 2024-01-27T13:33:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.243+0000 7f15a959a640 1 -- 172.21.15.46:0/3888251785 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1598003520 con 0x7f15ac0cce20 2024-01-27T13:33:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.243+0000 7f15aa59c640 1 -- 172.21.15.46:0/3888251785 >> v1:172.21.15.78:6789/0 conn(0x7f15ac0c9130 legacy=0x7f15ac0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.243+0000 7f15aa59c640 1 -- 172.21.15.46:0/3888251785 >> v1:172.21.15.46:6789/0 conn(0x7f15ac0cce20 legacy=0x7f15ac161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.243+0000 7f15aa59c640 1 -- 172.21.15.46:0/3888251785 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0c8140 con 0x7f15ac151a10 2024-01-27T13:33:00.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.246+0000 7f15aa59c640 1 --2- 172.21.15.46:0/3888251785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac158010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15a40097d0 tx=0x7f15a402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=646d91cc1949383a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.249+0000 7f15a959a640 1 -- 172.21.15.46:0/3888251785 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4030880 con 0x7f15ac151a10 2024-01-27T13:33:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.249+0000 7f15a959a640 1 -- 172.21.15.46:0/3888251785 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a40309e0 con 0x7f15ac151a10 2024-01-27T13:33:00.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.249+0000 7f15a959a640 1 -- 172.21.15.46:0/3888251785 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4030d70 con 0x7f15ac151a10 2024-01-27T13:33:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 -- 172.21.15.46:0/3888251785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 msgr2=0x7f15ac158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 --2- 172.21.15.46:0/3888251785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac158010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15a40097d0 tx=0x7f15a402b9c0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 -- 172.21.15.46:0/3888251785 shutdown_connections 2024-01-27T13:33:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 --2- 172.21.15.46:0/3888251785 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac158010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 -- 172.21.15.46:0/3888251785 >> 172.21.15.46:0/3888251785 conn(0x7f15ac0663a0 msgr2=0x7f15ac0667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:00.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 -- 172.21.15.46:0/3888251785 shutdown_connections 2024-01-27T13:33:00.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.250+0000 7f15b0943640 1 -- 172.21.15.46:0/3888251785 wait complete. 2024-01-27T13:33:00.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.251+0000 7f15b0943640 1 Processor -- start 2024-01-27T13:33:00.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.251+0000 7f15b0943640 1 -- start start 2024-01-27T13:33:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15b0943640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 0x7f15ac144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15b0943640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15ac0cce20 0x7f15ac1452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15b0943640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac1e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15b0943640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac1e1cc0 con 0x7f15ac0c9130 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15b0943640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b26b0 con 0x7f15ac0cce20 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15b0943640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b23d0 con 0x7f15ac151a10 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 0x7f15ac144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15a9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15ac0cce20 0x7f15ac1452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15aad9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac1e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15aa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 0x7f15ac144db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50106/0 (socket says 172.21.15.46:50106) 2024-01-27T13:33:00.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.252+0000 7f15aa59c640 1 -- 172.21.15.46:0/3153965266 learned_addr learned my addr 172.21.15.46:0/3153965266 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.256+0000 7f15aa59c640 1 -- 172.21.15.46:0/3153965266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 msgr2=0x7f15ac1e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.256+0000 7f15aa59c640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac1e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.256+0000 7f15aa59c640 1 -- 172.21.15.46:0/3153965266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15ac0cce20 msgr2=0x7f15ac1452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.256+0000 7f15aa59c640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15ac0cce20 0x7f15ac1452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.256+0000 7f15aa59c640 1 -- 172.21.15.46:0/3153965266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009400 con 0x7f15ac0c9130 2024-01-27T13:33:00.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.258+0000 7f15aa59c640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 0x7f15ac144db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15a40098f0 tx=0x7f15a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.262+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a403e070 con 0x7f15ac0c9130 2024-01-27T13:33:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.262+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4039b20 con 0x7f15ac0c9130 2024-01-27T13:33:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.262+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac0b1b90 con 0x7f15ac0c9130 2024-01-27T13:33:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.262+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a40423f0 con 0x7f15ac0c9130 2024-01-27T13:33:00.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.262+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0b1e70 con 0x7f15ac0c9130 2024-01-27T13:33:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.263+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac074410 con 0x7f15ac0c9130 2024-01-27T13:33:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.524+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f15a4042550 con 0x7f15ac0c9130 2024-01-27T13:33:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.524+0000 7f15a2ffd640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f158c06af20 0x7f158c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.524+0000 7f15a9d9b640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f158c06af20 0x7f158c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.525+0000 7f15a9d9b640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f158c06af20 0x7f158c06d3e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0c7430 tx=0x7f1594009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:00.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.537+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15a407a680 con 0x7f15ac0c9130 2024-01-27T13:33:00.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.537+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f15a4076a00 con 0x7f15ac0c9130 2024-01-27T13:33:00.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.714+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15ac0aff90 con 0x7f15ac0c9130 2024-01-27T13:33:00.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.719+0000 7f15a2ffd640 1 -- 172.21.15.46:0/3153965266 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15a4048020 con 0x7f15ac0c9130 2024-01-27T13:33:00.711 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T13:33:00.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f158c06af20 msgr2=0x7f158c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f158c06af20 0x7f158c06d3e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0c7430 tx=0x7f1594009040 comp rx=0 tx=0).stop 2024-01-27T13:33:00.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 msgr2=0x7f15ac144db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 0x7f15ac144db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f15a40098f0 tx=0x7f15a40046c0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 shutdown_connections 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f158c06af20 0x7f158c06d3e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f15ac151a10 0x7f15ac1e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15ac0cce20 0x7f15ac1452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 --2- 172.21.15.46:0/3153965266 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15ac0c9130 0x7f15ac144db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 >> 172.21.15.46:0/3153965266 conn(0x7f15ac0663a0 msgr2=0x7f15ac0cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 shutdown_connections 2024-01-27T13:33:00.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.722+0000 7f15b0943640 1 -- 172.21.15.46:0/3153965266 wait complete. 2024-01-27T13:33:00.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T13:33:00.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.836+0000 7fc3a9a9b640 1 Processor -- start 2024-01-27T13:33:00.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.836+0000 7fc3a9a9b640 1 -- start start 2024-01-27T13:33:00.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.837+0000 7fc3a9a9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc3a40c2ca0 0x7fc3a41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.837+0000 7fc3a9a9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c77d0 0x7fc3a4151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.837+0000 7fc3a9a9b640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a40ccf60 con 0x7fc3a40c28c0 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.837+0000 7fc3a9a9b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a40ca800 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.837+0000 7fc3a9a9b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41576d0 con 0x7fc3a40c77d0 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.838+0000 7fc3a37fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fc3a40c28c0 0x7fc3a40c1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47112/0 (socket says 172.21.15.46:47112) 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.838+0000 7fc3a37fe640 1 -- 172.21.15.46:0/405363376 learned_addr learned my addr 172.21.15.46:0/405363376 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.838+0000 7fc3a3fff640 1 --2- 172.21.15.46:0/405363376 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c77d0 0x7fc3a4151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.838+0000 7fc3a2ffd640 1 --2- 172.21.15.46:0/405363376 >> v2:172.21.15.78:3300/0 conn(0x7fc3a40c2ca0 0x7fc3a41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.840+0000 7fc3a27fc640 1 -- 172.21.15.46:0/405363376 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822090332 0 0) 0x7fc3a40ccf60 con 0x7fc3a40c28c0 2024-01-27T13:33:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.840+0000 7fc3a27fc640 1 -- 172.21.15.46:0/405363376 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc38c003520 con 0x7fc3a40c28c0 2024-01-27T13:33:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.841+0000 7fc3a3fff640 1 -- 172.21.15.46:0/405363376 >> v2:172.21.15.78:3300/0 conn(0x7fc3a40c2ca0 msgr2=0x7fc3a41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.841+0000 7fc3a3fff640 1 --2- 172.21.15.46:0/405363376 >> v2:172.21.15.78:3300/0 conn(0x7fc3a40c2ca0 0x7fc3a41514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.841+0000 7fc3a3fff640 1 -- 172.21.15.46:0/405363376 >> v1:172.21.15.46:6789/0 conn(0x7fc3a40c28c0 legacy=0x7fc3a40c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.841+0000 7fc3a3fff640 1 -- 172.21.15.46:0/405363376 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40cd200 con 0x7fc3a40c77d0 2024-01-27T13:33:00.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.844+0000 7fc3a3fff640 1 --2- 172.21.15.46:0/405363376 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c77d0 0x7fc3a4151a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009d90 tx=0x7fc39c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f96040a4577944 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a27fc640 1 -- 172.21.15.46:0/405363376 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c02cc50 con 0x7fc3a40c77d0 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a27fc640 1 -- 172.21.15.46:0/405363376 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c02cdb0 con 0x7fc3a40c77d0 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a27fc640 1 -- 172.21.15.46:0/405363376 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c034660 con 0x7fc3a40c77d0 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/405363376 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c77d0 msgr2=0x7fc3a4151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/405363376 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c77d0 0x7fc3a4151a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009d90 tx=0x7fc39c02bea0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/405363376 shutdown_connections 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/405363376 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c77d0 0x7fc3a4151a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/405363376 >> v2:172.21.15.78:3300/0 conn(0x7fc3a40c2ca0 0x7fc3a41514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/405363376 >> 172.21.15.46:0/405363376 conn(0x7fc3a406efe0 msgr2=0x7fc3a406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.848+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/405363376 shutdown_connections 2024-01-27T13:33:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.849+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/405363376 wait complete. 2024-01-27T13:33:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.850+0000 7fc3a9a9b640 1 Processor -- start 2024-01-27T13:33:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.850+0000 7fc3a9a9b640 1 -- start start 2024-01-27T13:33:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.850+0000 7fc3a9a9b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c28c0 0x7fc3a4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a9a9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 0x7fc3a41ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a9a9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3a40c77d0 0x7fc3a40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a9a9b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41ddcc0 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a9a9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41f0f90 con 0x7fc3a40c77d0 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a9a9b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41f14c0 con 0x7fc3a40c28c0 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 0x7fc3a41ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a37fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c28c0 0x7fc3a4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3a40c77d0 0x7fc3a40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 0x7fc3a41ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50112/0 (socket says 172.21.15.46:50112) 2024-01-27T13:33:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.851+0000 7fc3a2ffd640 1 -- 172.21.15.46:0/3233417195 learned_addr learned my addr 172.21.15.46:0/3233417195 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.855+0000 7fc3a2ffd640 1 -- 172.21.15.46:0/3233417195 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c28c0 msgr2=0x7fc3a4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.855+0000 7fc3a2ffd640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c28c0 0x7fc3a4154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.855+0000 7fc3a2ffd640 1 -- 172.21.15.46:0/3233417195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3a40c77d0 msgr2=0x7fc3a40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:00.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.855+0000 7fc3a2ffd640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3a40c77d0 0x7fc3a40cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:00.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.855+0000 7fc3a2ffd640 1 -- 172.21.15.46:0/3233417195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c009a70 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.858+0000 7fc3a2ffd640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 0x7fc3a41ed9b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc39800e8e0 tx=0x7fc39800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.861+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800c940 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.862+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39800caa0 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.862+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a41ed520 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.862+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39800ce30 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.862+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a41f11e0 con 0x7fc3a40c2ca0 2024-01-27T13:33:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:00.863+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4074410 con 0x7fc3a40c2ca0 2024-01-27T13:33:01.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.125+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc398013470 con 0x7fc3a40c2ca0 2024-01-27T13:33:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.125+0000 7fc38bfff640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39006af20 0x7fc39006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.126+0000 7fc3a37fe640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39006af20 0x7fc39006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.126+0000 7fc3a37fe640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39006af20 0x7fc39006d3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc394005880 tx=0x7fc394009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:01.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.143+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc398058c40 con 0x7fc3a40c2ca0 2024-01-27T13:33:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.143+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc398054f80 con 0x7fc3a40c2ca0 2024-01-27T13:33:01.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.328+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3a41572e0 con 0x7fc3a40c2ca0 2024-01-27T13:33:01.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.333+0000 7fc38bfff640 1 -- 172.21.15.46:0/3233417195 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc3980210a0 con 0x7fc3a40c2ca0 2024-01-27T13:33:01.326 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:33:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39006af20 msgr2=0x7fc39006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:01.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39006af20 0x7fc39006d3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc394005880 tx=0x7fc394009040 comp rx=0 tx=0).stop 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 msgr2=0x7fc3a41ed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 0x7fc3a41ed9b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc39800e8e0 tx=0x7fc39800eda0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 shutdown_connections 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39006af20 0x7fc39006d3e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3a40c77d0 0x7fc3a40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3a40c2ca0 0x7fc3a41ed9b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 --2- 172.21.15.46:0/3233417195 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3a40c28c0 0x7fc3a4154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 >> 172.21.15.46:0/3233417195 conn(0x7fc3a406efe0 msgr2=0x7fc3a4155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 shutdown_connections 2024-01-27T13:33:01.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.336+0000 7fc3a9a9b640 1 -- 172.21.15.46:0/3233417195 wait complete. 2024-01-27T13:33:01.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:33:01.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.449+0000 7f6e1cd89640 1 Processor -- start 2024-01-27T13:33:01.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.449+0000 7f6e1cd89640 1 -- start start 2024-01-27T13:33:01.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e1cd89640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e18153b80 0x7f6e181598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e1cd89640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e180c99d0 0x7f6e180c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e1cd89640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180c7620 con 0x7f6e180c8010 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e1cd89640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e180c67b0 con 0x7f6e180c99d0 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e1cd89640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180c8440 con 0x7f6e18153b80 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e0ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e180c99d0 0x7f6e180c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.450+0000 7f6e0ffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f6e180c99d0 0x7f6e180c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50126/0 (socket says 172.21.15.46:50126) 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.451+0000 7f6e0ffff640 1 -- 172.21.15.46:0/4108883366 learned_addr learned my addr 172.21.15.46:0/4108883366 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:01.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.451+0000 7f6e1659c640 1 --2- 172.21.15.46:0/4108883366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e18153b80 0x7f6e181598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.453+0000 7f6e0ffff640 1 -- 172.21.15.46:0/4108883366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e18153b80 msgr2=0x7f6e181598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:01.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.453+0000 7f6e0ffff640 1 --2- 172.21.15.46:0/4108883366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e18153b80 0x7f6e181598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.453+0000 7f6e0ffff640 1 -- 172.21.15.46:0/4108883366 >> v1:172.21.15.78:6789/0 conn(0x7f6e180c8010 legacy=0x7f6e1806ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:01.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.453+0000 7f6e0ffff640 1 -- 172.21.15.46:0/4108883366 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180ca180 con 0x7f6e180c99d0 2024-01-27T13:33:01.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.455+0000 7f6e0ffff640 1 --2- 172.21.15.46:0/4108883366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e180c99d0 0x7f6e180c7ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009870 tx=0x7f6e0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03832ff525a905e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.458+0000 7f6e15d9b640 1 -- 172.21.15.46:0/4108883366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031640 con 0x7f6e180c99d0 2024-01-27T13:33:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.458+0000 7f6e15d9b640 1 -- 172.21.15.46:0/4108883366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000317a0 con 0x7f6e180c99d0 2024-01-27T13:33:01.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.458+0000 7f6e15d9b640 1 -- 172.21.15.46:0/4108883366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031b30 con 0x7f6e180c99d0 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 -- 172.21.15.46:0/4108883366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e180c99d0 msgr2=0x7f6e180c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/4108883366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e180c99d0 0x7f6e180c7ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009870 tx=0x7f6e0002b8f0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 -- 172.21.15.46:0/4108883366 shutdown_connections 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/4108883366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e180c99d0 0x7f6e180c7ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/4108883366 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e18153b80 0x7f6e181598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 -- 172.21.15.46:0/4108883366 >> 172.21.15.46:0/4108883366 conn(0x7f6e180cf230 msgr2=0x7f6e180cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 -- 172.21.15.46:0/4108883366 shutdown_connections 2024-01-27T13:33:01.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.459+0000 7f6e1cd89640 1 -- 172.21.15.46:0/4108883366 wait complete. 2024-01-27T13:33:01.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.461+0000 7f6e1cd89640 1 Processor -- start 2024-01-27T13:33:01.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.461+0000 7f6e1cd89640 1 -- start start 2024-01-27T13:33:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1cd89640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180c8010 0x7f6e181f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1cd89640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e180c99d0 0x7f6e181f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1cd89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e18153b80 0x7f6e181f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1cd89640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181e59d0 con 0x7f6e18153b80 2024-01-27T13:33:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1cd89640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181e4930 con 0x7f6e180c8010 2024-01-27T13:33:01.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1cd89640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181e4c10 con 0x7f6e180c99d0 2024-01-27T13:33:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e1659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180c8010 0x7f6e181f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e0ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e180c99d0 0x7f6e181f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.462+0000 7f6e16d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e18153b80 0x7f6e181f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.463+0000 7f6e16d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e18153b80 0x7f6e181f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50142/0 (socket says 172.21.15.46:50142) 2024-01-27T13:33:01.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.463+0000 7f6e16d9d640 1 -- 172.21.15.46:0/679859165 learned_addr learned my addr 172.21.15.46:0/679859165 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.466+0000 7f6e0ffff640 1 -- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180c8010 msgr2=0x7f6e181f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.466+0000 7f6e0ffff640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180c8010 0x7f6e181f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.466+0000 7f6e0ffff640 1 -- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e18153b80 msgr2=0x7f6e181f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.466+0000 7f6e0ffff640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e18153b80 0x7f6e181f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:01.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.466+0000 7f6e0ffff640 1 -- 172.21.15.46:0/679859165 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000094d0 con 0x7f6e180c99d0 2024-01-27T13:33:01.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.468+0000 7f6e0ffff640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e180c99d0 0x7f6e181f27d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e00033000 tx=0x7f6e000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:01.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.472+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0003a9f0 con 0x7f6e180c99d0 2024-01-27T13:33:01.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.472+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0003ab90 con 0x7f6e180c99d0 2024-01-27T13:33:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.472+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e181e4ef0 con 0x7f6e180c99d0 2024-01-27T13:33:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.472+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e000443f0 con 0x7f6e180c99d0 2024-01-27T13:33:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.472+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e181e54b0 con 0x7f6e180c99d0 2024-01-27T13:33:01.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.473+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e18067ca0 con 0x7f6e180c99d0 2024-01-27T13:33:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.717+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6e0002f050 con 0x7f6e180c99d0 2024-01-27T13:33:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.717+0000 7f6e0effd640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6df806af20 0x7f6df806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:01.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.717+0000 7f6e1659c640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6df806af20 0x7f6df806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:01.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.717+0000 7f6e1659c640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6df806af20 0x7f6df806d3e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009aa0 tx=0x7f6e08009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:01.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.719+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6e0007a4d0 con 0x7f6e180c99d0 2024-01-27T13:33:01.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.730+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6e00076810 con 0x7f6e180c99d0 2024-01-27T13:33:01.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:01.962+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e18074410 con 0x7f6e180c99d0 2024-01-27T13:33:02.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.071+0000 7f6e0effd640 1 -- 172.21.15.46:0/679859165 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6514 (secure 0 0 0) 0x7f6e00035090 con 0x7f6e180c99d0 2024-01-27T13:33:02.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:33:02.063 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:45.974762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T13:33:02.064 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-01-27T13:33:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6df806af20 msgr2=0x7f6df806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6df806af20 0x7f6df806d3e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009aa0 tx=0x7f6e08009190 comp rx=0 tx=0).stop 2024-01-27T13:33:02.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e180c99d0 msgr2=0x7f6e181f27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e180c99d0 0x7f6e181f27d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e00033000 tx=0x7f6e000046c0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 shutdown_connections 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6df806af20 0x7f6df806d3e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e18153b80 0x7f6e181f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6e180c99d0 0x7f6e181f27d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 --2- 172.21.15.46:0/679859165 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e180c8010 0x7f6e181f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 >> 172.21.15.46:0/679859165 conn(0x7f6e180cf230 msgr2=0x7f6e180c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 shutdown_connections 2024-01-27T13:33:02.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.073+0000 7f6e1cd89640 1 -- 172.21.15.46:0/679859165 wait complete. 2024-01-27T13:33:02.076 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:33:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.188+0000 7f5157097640 1 Processor -- start 2024-01-27T13:33:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.188+0000 7f5157097640 1 -- start start 2024-01-27T13:33:02.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.188+0000 7f5157097640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5150150500 0x7f51500c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.189+0000 7f5157097640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 0x7f51500c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.189+0000 7f5157097640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500c6c30 con 0x7f51500c1e80 2024-01-27T13:33:02.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.189+0000 7f5157097640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51500c7780 con 0x7f5150150500 2024-01-27T13:33:02.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.189+0000 7f5157097640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51501508e0 con 0x7f51500c6260 2024-01-27T13:33:02.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.189+0000 7f5155634640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 0x7f51500c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.189+0000 7f5154e33640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5150150500 0x7f51500c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.190+0000 7f5155634640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 0x7f51500c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:43086/0 (socket says 172.21.15.46:43086) 2024-01-27T13:33:02.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.190+0000 7f5155634640 1 -- 172.21.15.46:0/2764688869 learned_addr learned my addr 172.21.15.46:0/2764688869 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.192+0000 7f5155634640 1 -- 172.21.15.46:0/2764688869 >> v2:172.21.15.78:3300/0 conn(0x7f5150150500 msgr2=0x7f51500c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.192+0000 7f5155634640 1 --2- 172.21.15.46:0/2764688869 >> v2:172.21.15.78:3300/0 conn(0x7f5150150500 0x7f51500c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.192+0000 7f5155634640 1 -- 172.21.15.46:0/2764688869 >> v1:172.21.15.46:6789/0 conn(0x7f51500c1e80 legacy=0x7f51500bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.192+0000 7f5155634640 1 -- 172.21.15.46:0/2764688869 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150156600 con 0x7f51500c6260 2024-01-27T13:33:02.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.194+0000 7f5155634640 1 --2- 172.21.15.46:0/2764688869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 0x7f51500c66f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5148009e50 tx=0x7f514802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f30c942fb19e533 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:02.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.197+0000 7f514f7fe640 1 -- 172.21.15.46:0/2764688869 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514802ca70 con 0x7f51500c6260 2024-01-27T13:33:02.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.197+0000 7f514f7fe640 1 -- 172.21.15.46:0/2764688869 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514802cbd0 con 0x7f51500c6260 2024-01-27T13:33:02.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f514f7fe640 1 -- 172.21.15.46:0/2764688869 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51480343f0 con 0x7f51500c6260 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 -- 172.21.15.46:0/2764688869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 msgr2=0x7f51500c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 --2- 172.21.15.46:0/2764688869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 0x7f51500c66f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5148009e50 tx=0x7f514802bed0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 -- 172.21.15.46:0/2764688869 shutdown_connections 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 --2- 172.21.15.46:0/2764688869 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f51500c6260 0x7f51500c66f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 --2- 172.21.15.46:0/2764688869 >> v2:172.21.15.78:3300/0 conn(0x7f5150150500 0x7f51500c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 -- 172.21.15.46:0/2764688869 >> 172.21.15.46:0/2764688869 conn(0x7f51500cae90 msgr2=0x7f51500cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 -- 172.21.15.46:0/2764688869 shutdown_connections 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.198+0000 7f5157097640 1 -- 172.21.15.46:0/2764688869 wait complete. 2024-01-27T13:33:02.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.199+0000 7f5157097640 1 Processor -- start 2024-01-27T13:33:02.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.199+0000 7f5157097640 1 -- start start 2024-01-27T13:33:02.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.200+0000 7f5157097640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500c1e80 0x7f5150151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.200+0000 7f5157097640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 0x7f51500c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.200+0000 7f5157097640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5150150500 0x7f51500c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.200+0000 7f5157097640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51501e1080 con 0x7f51500c1e80 2024-01-27T13:33:02.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.200+0000 7f5157097640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51501ecca0 con 0x7f51500c6260 2024-01-27T13:33:02.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.200+0000 7f5157097640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51501e1270 con 0x7f5150150500 2024-01-27T13:33:02.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.201+0000 7f514ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 0x7f51500c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.201+0000 7f5155634640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5150150500 0x7f51500c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.201+0000 7f514ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 0x7f51500c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:42634/0 (socket says 172.21.15.46:42634) 2024-01-27T13:33:02.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.201+0000 7f514ffff640 1 -- 172.21.15.46:0/254597864 learned_addr learned my addr 172.21.15.46:0/254597864 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:02.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.204+0000 7f514ffff640 1 -- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5150150500 msgr2=0x7f51500c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.204+0000 7f514ffff640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5150150500 0x7f51500c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.204+0000 7f514ffff640 1 -- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500c1e80 msgr2=0x7f5150151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.204+0000 7f514ffff640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500c1e80 0x7f5150151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.204+0000 7f514ffff640 1 -- 172.21.15.46:0/254597864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5148009b30 con 0x7f51500c6260 2024-01-27T13:33:02.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.207+0000 7f514ffff640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 0x7f51500c8c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b3c0 tx=0x7f513c00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.210+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c011830 con 0x7f51500c6260 2024-01-27T13:33:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.210+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c011990 con 0x7f51500c6260 2024-01-27T13:33:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.210+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c011d60 con 0x7f51500c6260 2024-01-27T13:33:02.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.210+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51501ecf20 con 0x7f51500c6260 2024-01-27T13:33:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.210+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51501ed4e0 con 0x7f51500c6260 2024-01-27T13:33:02.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.211+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150156ba0 con 0x7f51500c6260 2024-01-27T13:33:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.453+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f513c01b460 con 0x7f51500c6260 2024-01-27T13:33:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.453+0000 7f514d7fa640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f513406af20 0x7f513406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.453+0000 7f5154e33640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f513406af20 0x7f513406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.454+0000 7f5154e33640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f513406af20 0x7f513406d3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5144006a90 tx=0x7f5144006a20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:02.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.456+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f513c058f40 con 0x7f51500c6260 2024-01-27T13:33:02.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.468+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f513c054b80 con 0x7f51500c6260 2024-01-27T13:33:02.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.648+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5150156ba0 con 0x7f51500c6260 2024-01-27T13:33:02.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.687+0000 7f514d7fa640 1 -- 172.21.15.46:0/254597864 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f5150156ba0 con 0x7f51500c6260 2024-01-27T13:33:02.680 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:33:02.680 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:33:02.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f513406af20 msgr2=0x7f513406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f513406af20 0x7f513406d3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5144006a90 tx=0x7f5144006a20 comp rx=0 tx=0).stop 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 msgr2=0x7f51500c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 0x7f51500c8c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b3c0 tx=0x7f513c00b880 comp rx=0 tx=0).stop 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 shutdown_connections 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f513406af20 0x7f513406d3e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5150150500 0x7f51500c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f51500c6260 0x7f51500c8c90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 --2- 172.21.15.46:0/254597864 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51500c1e80 0x7f5150151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 >> 172.21.15.46:0/254597864 conn(0x7f51500cae90 msgr2=0x7f5150154770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 shutdown_connections 2024-01-27T13:33:02.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.689+0000 7f5157097640 1 -- 172.21.15.46:0/254597864 wait complete. 2024-01-27T13:33:02.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T13:32:10.212389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T13:32:11.933652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T13:32:15.934129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T13:33:02.693 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:33:02.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 Processor -- start 2024-01-27T13:33:02.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 -- start start 2024-01-27T13:33:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a200cb1e0 0x7f6a2015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6a200c7690 0x7f6a200c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2015a8a0 con 0x7f6a20153db0 2024-01-27T13:33:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a200c99d0 con 0x7f6a200c7690 2024-01-27T13:33:02.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.808+0000 7f6a266c2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200cab10 con 0x7f6a200cb1e0 2024-01-27T13:33:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.809+0000 7f6a1ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6a20153db0 0x7f6a2006b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47120/0 (socket says 172.21.15.46:47120) 2024-01-27T13:33:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.809+0000 7f6a1ffff640 1 -- 172.21.15.46:0/1177146475 learned_addr learned my addr 172.21.15.46:0/1177146475 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.809+0000 7f6a24c5f640 1 --2- 172.21.15.46:0/1177146475 >> v2:172.21.15.78:3300/0 conn(0x7f6a200c7690 0x7f6a200c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.809+0000 7f6a1f7fe640 1 --2- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a200cb1e0 0x7f6a2015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.812+0000 7f6a24c5f640 1 -- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a200cb1e0 msgr2=0x7f6a2015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.812+0000 7f6a24c5f640 1 --2- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a200cb1e0 0x7f6a2015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.812+0000 7f6a24c5f640 1 -- 172.21.15.46:0/1177146475 >> v1:172.21.15.46:6789/0 conn(0x7f6a20153db0 legacy=0x7f6a2006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.812+0000 7f6a24c5f640 1 -- 172.21.15.46:0/1177146475 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200c8030 con 0x7f6a200c7690 2024-01-27T13:33:02.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.812+0000 7f6a1effd640 1 -- 172.21.15.46:0/1177146475 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36756576 0 0) 0x7f6a10001110 con 0x7f6a20153db0 2024-01-27T13:33:02.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.814+0000 7f6a24c5f640 1 --2- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a200c7af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009d90 tx=0x7f6a1802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a268dc589b13aedd server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:02.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.817+0000 7f6a1effd640 1 -- 172.21.15.46:0/1177146475 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1802cc50 con 0x7f6a200c7690 2024-01-27T13:33:02.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.817+0000 7f6a1effd640 1 -- 172.21.15.46:0/1177146475 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1802cdb0 con 0x7f6a200c7690 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a1effd640 1 -- 172.21.15.46:0/1177146475 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18034660 con 0x7f6a200c7690 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 -- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 msgr2=0x7f6a200c7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 --2- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a200c7af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009d90 tx=0x7f6a1802bea0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 -- 172.21.15.46:0/1177146475 shutdown_connections 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 --2- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a200c7af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 --2- 172.21.15.46:0/1177146475 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a200cb1e0 0x7f6a2015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 -- 172.21.15.46:0/1177146475 >> 172.21.15.46:0/1177146475 conn(0x7f6a200cf050 msgr2=0x7f6a200cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 -- 172.21.15.46:0/1177146475 shutdown_connections 2024-01-27T13:33:02.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.818+0000 7f6a266c2640 1 -- 172.21.15.46:0/1177146475 wait complete. 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.819+0000 7f6a266c2640 1 Processor -- start 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 -- start start 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a201e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a200cb1e0 0x7f6a200c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a20153db0 0x7f6a20149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20159370 con 0x7f6a200cb1e0 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201e4b20 con 0x7f6a200c7690 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.820+0000 7f6a266c2640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a201e3390 con 0x7f6a20153db0 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.821+0000 7f6a1f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a200cb1e0 0x7f6a200c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.821+0000 7f6a24c5f640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a20153db0 0x7f6a20149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.821+0000 7f6a1f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a200cb1e0 0x7f6a200c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50164/0 (socket says 172.21.15.46:50164) 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.821+0000 7f6a1f7fe640 1 -- 172.21.15.46:0/2628273826 learned_addr learned my addr 172.21.15.46:0/2628273826 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:02.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.821+0000 7f6a1ffff640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a201e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.825+0000 7f6a1ffff640 1 -- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a20153db0 msgr2=0x7f6a20149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.825+0000 7f6a1ffff640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a20153db0 0x7f6a20149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.825+0000 7f6a1ffff640 1 -- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a200cb1e0 msgr2=0x7f6a200c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:02.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.825+0000 7f6a1ffff640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a200cb1e0 0x7f6a200c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.825+0000 7f6a1ffff640 1 -- 172.21.15.46:0/2628273826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18009a70 con 0x7f6a200c7690 2024-01-27T13:33:02.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.825+0000 7f6a24c5f640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a20153db0 0x7f6a20149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:33:02.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.827+0000 7f6a1ffff640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a201e58c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000c3e0 tx=0x7f6a1000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:02.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.830+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a100074e0 con 0x7f6a200c7690 2024-01-27T13:33:02.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.830+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a10007640 con 0x7f6a200c7690 2024-01-27T13:33:02.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.830+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10004a00 con 0x7f6a200c7690 2024-01-27T13:33:02.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.831+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a201e3670 con 0x7f6a200c7690 2024-01-27T13:33:02.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.831+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a201e50a0 con 0x7f6a200c7690 2024-01-27T13:33:02.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:02.832+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a200c6f60 con 0x7f6a200c7690 2024-01-27T13:33:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.071+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6a10004b60 con 0x7f6a200c7690 2024-01-27T13:33:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.071+0000 7f6a1cff9640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6a0c06af20 0x7f6a0c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.071+0000 7f6a1f7fe640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6a0c06af20 0x7f6a0c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:03.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.071+0000 7f6a1f7fe640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6a0c06af20 0x7f6a0c06d3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a20157550 tx=0x7f6a14009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:03.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.074+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a100582d0 con 0x7f6a200c7690 2024-01-27T13:33:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.083+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6a10054610 con 0x7f6a200c7690 2024-01-27T13:33:03.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.270+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a2015a8a0 con 0x7f6a200c7690 2024-01-27T13:33:03.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.276+0000 7f6a1cff9640 1 -- 172.21.15.46:0/2628273826 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a2015a8a0 con 0x7f6a200c7690 2024-01-27T13:33:03.268 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:33:03.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6a0c06af20 msgr2=0x7f6a0c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6a0c06af20 0x7f6a0c06d3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a20157550 tx=0x7f6a14009190 comp rx=0 tx=0).stop 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 msgr2=0x7f6a201e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a201e58c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000c3e0 tx=0x7f6a1000c8a0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 shutdown_connections 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6a0c06af20 0x7f6a0c06d3e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6a20153db0 0x7f6a20149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a200cb1e0 0x7f6a200c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 --2- 172.21.15.46:0/2628273826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a200c7690 0x7f6a201e58c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 >> 172.21.15.46:0/2628273826 conn(0x7f6a200cf050 msgr2=0x7f6a200cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 shutdown_connections 2024-01-27T13:33:03.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.278+0000 7f6a266c2640 1 -- 172.21.15.46:0/2628273826 wait complete. 2024-01-27T13:33:03.281 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T13:33:03.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.393+0000 7fb92c705640 1 Processor -- start 2024-01-27T13:33:03.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.393+0000 7fb92c705640 1 -- start start 2024-01-27T13:33:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.394+0000 7fb92c705640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9240c4750 0x7fb9240c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.394+0000 7fb92c705640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92415a280 con 0x7fb9240c5b00 2024-01-27T13:33:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.394+0000 7fb92c705640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92415a790 con 0x7fb924153ca0 2024-01-27T13:33:03.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.394+0000 7fb92c705640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9240c5f70 con 0x7fb9240c4750 2024-01-27T13:33:03.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.394+0000 7fb92aca2640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb9240c5b00 0x7fb92406c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47122/0 (socket says 172.21.15.46:47122) 2024-01-27T13:33:03.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.394+0000 7fb92aca2640 1 -- 172.21.15.46:0/2694472888 learned_addr learned my addr 172.21.15.46:0/2694472888 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:03.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.395+0000 7fb929ca0640 1 --2- 172.21.15.46:0/2694472888 >> v2:172.21.15.78:3300/0 conn(0x7fb9240c4750 0x7fb9240c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:03.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.397+0000 7fb92949f640 1 -- 172.21.15.46:0/2694472888 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569498567 0 0) 0x7fb92415a280 con 0x7fb9240c5b00 2024-01-27T13:33:03.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.397+0000 7fb92949f640 1 -- 172.21.15.46:0/2694472888 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb90c003520 con 0x7fb9240c5b00 2024-01-27T13:33:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.399+0000 7fb929ca0640 1 -- 172.21.15.46:0/2694472888 >> v1:172.21.15.78:6789/0 conn(0x7fb924153ca0 legacy=0x7fb92406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.399+0000 7fb929ca0640 1 -- 172.21.15.46:0/2694472888 >> v1:172.21.15.46:6789/0 conn(0x7fb9240c5b00 legacy=0x7fb92406c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.399+0000 7fb929ca0640 1 -- 172.21.15.46:0/2694472888 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92415a4b0 con 0x7fb9240c4750 2024-01-27T13:33:03.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.402+0000 7fb929ca0640 1 --2- 172.21.15.46:0/2694472888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb9240c41b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097a0 tx=0x7fb91802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4282ae98191f8ac2 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.407+0000 7fb92949f640 1 -- 172.21.15.46:0/2694472888 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91802f810 con 0x7fb9240c4750 2024-01-27T13:33:03.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.407+0000 7fb92949f640 1 -- 172.21.15.46:0/2694472888 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91802f970 con 0x7fb9240c4750 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.407+0000 7fb92949f640 1 -- 172.21.15.46:0/2694472888 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91802fd00 con 0x7fb9240c4750 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 -- 172.21.15.46:0/2694472888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 msgr2=0x7fb9240c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 --2- 172.21.15.46:0/2694472888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb9240c41b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb9180097a0 tx=0x7fb91802b9f0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 -- 172.21.15.46:0/2694472888 shutdown_connections 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 --2- 172.21.15.46:0/2694472888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb9240c41b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 -- 172.21.15.46:0/2694472888 >> 172.21.15.46:0/2694472888 conn(0x7fb9240cf230 msgr2=0x7fb9240cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 -- 172.21.15.46:0/2694472888 shutdown_connections 2024-01-27T13:33:03.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.408+0000 7fb92c705640 1 -- 172.21.15.46:0/2694472888 wait complete. 2024-01-27T13:33:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.409+0000 7fb92c705640 1 Processor -- start 2024-01-27T13:33:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.409+0000 7fb92c705640 1 -- start start 2024-01-27T13:33:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb92c705640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb924156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb92c705640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 0x7fb924154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb92c705640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb924153ca0 0x7fb924155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb92c705640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924155cb0 con 0x7fb9240c5b00 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb92c705640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924154cf0 con 0x7fb9240c4750 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb92c705640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241f0560 con 0x7fb924153ca0 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.410+0000 7fb929ca0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 0x7fb924154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.411+0000 7fb929ca0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 0x7fb924154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50174/0 (socket says 172.21.15.46:50174) 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.411+0000 7fb929ca0640 1 -- 172.21.15.46:0/2371996996 learned_addr learned my addr 172.21.15.46:0/2371996996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.411+0000 7fb92aca2640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb924153ca0 0x7fb924155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.411+0000 7fb92a4a1640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb924156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.414+0000 7fb929ca0640 1 -- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb924153ca0 msgr2=0x7fb924155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.414+0000 7fb929ca0640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb924153ca0 0x7fb924155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.414+0000 7fb929ca0640 1 -- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 msgr2=0x7fb924156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.414+0000 7fb929ca0640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb924156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.414+0000 7fb929ca0640 1 -- 172.21.15.46:0/2371996996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009400 con 0x7fb9240c5b00 2024-01-27T13:33:03.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.417+0000 7fb929ca0640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 0x7fb924154170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9180098c0 tx=0x7fb9180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.420+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918046070 con 0x7fb9240c5b00 2024-01-27T13:33:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.420+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9180376d0 con 0x7fb9240c5b00 2024-01-27T13:33:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.420+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb924154790 con 0x7fb9240c5b00 2024-01-27T13:33:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.420+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91803b040 con 0x7fb9240c5b00 2024-01-27T13:33:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.420+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9241eff10 con 0x7fb9240c5b00 2024-01-27T13:33:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.421+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9241efd70 con 0x7fb9240c5b00 2024-01-27T13:33:03.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.682+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb918037a80 con 0x7fb9240c5b00 2024-01-27T13:33:03.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.682+0000 7fb922ffd640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91006af50 0x7fb91006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.682+0000 7fb92a4a1640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91006af50 0x7fb91006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:03.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.683+0000 7fb92a4a1640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91006af50 0x7fb91006d410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb914001f10 tx=0x7fb914009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.696+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb91807b110 con 0x7fb9240c5b00 2024-01-27T13:33:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.696+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb918077450 con 0x7fb9240c5b00 2024-01-27T13:33:03.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.882+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9241efd70 con 0x7fb9240c5b00 2024-01-27T13:33:03.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.887+0000 7fb922ffd640 1 -- 172.21.15.46:0/2371996996 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9241efd70 con 0x7fb9240c5b00 2024-01-27T13:33:03.879 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91006af50 msgr2=0x7fb91006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91006af50 0x7fb91006d410 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb914001f10 tx=0x7fb914009040 comp rx=0 tx=0).stop 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 msgr2=0x7fb924154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 0x7fb924154170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb9180098c0 tx=0x7fb9180046c0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 shutdown_connections 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91006af50 0x7fb91006d410 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb924153ca0 0x7fb924155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9240c5b00 0x7fb924154170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 --2- 172.21.15.46:0/2371996996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9240c4750 0x7fb924156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:03.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 >> 172.21.15.46:0/2371996996 conn(0x7fb9240cf230 msgr2=0x7fb92406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:03.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 shutdown_connections 2024-01-27T13:33:03.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:03.889+0000 7fb92c705640 1 -- 172.21.15.46:0/2371996996 wait complete. 2024-01-27T13:33:03.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T13:33:03.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.004+0000 7efd39e99640 1 Processor -- start 2024-01-27T13:33:03.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.004+0000 7efd39e99640 1 -- start start 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.005+0000 7efd39e99640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efd3406b820 0x7efd3406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.005+0000 7efd39e99640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3415d500 con 0x7efd3415d990 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.005+0000 7efd39e99640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340c7b50 con 0x7efd340c7d70 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.005+0000 7efd39e99640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3406c140 con 0x7efd3406b820 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.005+0000 7efd32ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7efd3415d990 0x7efd34159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47132/0 (socket says 172.21.15.46:47132) 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.006+0000 7efd32ffd640 1 -- 172.21.15.46:0/1520418211 learned_addr learned my addr 172.21.15.46:0/1520418211 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:03.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.006+0000 7efd337fe640 1 --2- 172.21.15.46:0/1520418211 >> v2:172.21.15.78:3300/0 conn(0x7efd3406b820 0x7efd3406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.008+0000 7efd327fc640 1 -- 172.21.15.46:0/1520418211 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227900467 0 0) 0x7efd3415d500 con 0x7efd3415d990 2024-01-27T13:33:04.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.008+0000 7efd327fc640 1 -- 172.21.15.46:0/1520418211 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd1c003520 con 0x7efd3415d990 2024-01-27T13:33:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.009+0000 7efd337fe640 1 -- 172.21.15.46:0/1520418211 >> v1:172.21.15.78:6789/0 conn(0x7efd340c7d70 legacy=0x7efd341640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.009+0000 7efd337fe640 1 -- 172.21.15.46:0/1520418211 >> v1:172.21.15.46:6789/0 conn(0x7efd3415d990 legacy=0x7efd34159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.009+0000 7efd337fe640 1 -- 172.21.15.46:0/1520418211 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3415a1d0 con 0x7efd3406b820 2024-01-27T13:33:04.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.011+0000 7efd337fe640 1 --2- 172.21.15.46:0/1520418211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd3406bc00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efd3406c280 tx=0x7efd2402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5436504aa2cab203 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd327fc640 1 -- 172.21.15.46:0/1520418211 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24031830 con 0x7efd3406b820 2024-01-27T13:33:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd327fc640 1 -- 172.21.15.46:0/1520418211 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24031990 con 0x7efd3406b820 2024-01-27T13:33:04.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd327fc640 1 -- 172.21.15.46:0/1520418211 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24031d20 con 0x7efd3406b820 2024-01-27T13:33:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd39e99640 1 -- 172.21.15.46:0/1520418211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 msgr2=0x7efd3406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd39e99640 1 --2- 172.21.15.46:0/1520418211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd3406bc00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efd3406c280 tx=0x7efd2402b8d0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd39e99640 1 -- 172.21.15.46:0/1520418211 shutdown_connections 2024-01-27T13:33:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd39e99640 1 --2- 172.21.15.46:0/1520418211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd3406bc00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.016+0000 7efd39e99640 1 -- 172.21.15.46:0/1520418211 >> 172.21.15.46:0/1520418211 conn(0x7efd340663a0 msgr2=0x7efd340667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.017+0000 7efd39e99640 1 -- 172.21.15.46:0/1520418211 shutdown_connections 2024-01-27T13:33:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.017+0000 7efd39e99640 1 -- 172.21.15.46:0/1520418211 wait complete. 2024-01-27T13:33:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.018+0000 7efd39e99640 1 Processor -- start 2024-01-27T13:33:04.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.018+0000 7efd39e99640 1 -- start start 2024-01-27T13:33:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd39e99640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd34154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd39e99640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd340c7d70 0x7efd34157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd39e99640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd3415d990 0x7efd3415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd39e99640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340c65f0 con 0x7efd3415d990 2024-01-27T13:33:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd39e99640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd341587e0 con 0x7efd3406b820 2024-01-27T13:33:04.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd39e99640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd34158570 con 0x7efd340c7d70 2024-01-27T13:33:04.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd34154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd33fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd3415d990 0x7efd3415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd32ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd340c7d70 0x7efd34157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd33fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd3415d990 0x7efd3415bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50176/0 (socket says 172.21.15.46:50176) 2024-01-27T13:33:04.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd34154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:42680/0 (socket says 172.21.15.46:42680) 2024-01-27T13:33:04.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.019+0000 7efd33fff640 1 -- 172.21.15.46:0/1465959034 learned_addr learned my addr 172.21.15.46:0/1465959034 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.023+0000 7efd337fe640 1 -- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd340c7d70 msgr2=0x7efd34157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.023+0000 7efd337fe640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd340c7d70 0x7efd34157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.023+0000 7efd337fe640 1 -- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd3415d990 msgr2=0x7efd3415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.023+0000 7efd337fe640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd3415d990 0x7efd3415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.023+0000 7efd337fe640 1 -- 172.21.15.46:0/1465959034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd24009400 con 0x7efd3406b820 2024-01-27T13:33:04.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.025+0000 7efd337fe640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd34154090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd24033000 tx=0x7efd240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.028+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2403a8f0 con 0x7efd3406b820 2024-01-27T13:33:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.028+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2403aa50 con 0x7efd3406b820 2024-01-27T13:33:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.028+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2403ade0 con 0x7efd3406b820 2024-01-27T13:33:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.028+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd34159090 con 0x7efd3406b820 2024-01-27T13:33:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.029+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd34158a10 con 0x7efd3406b820 2024-01-27T13:33:04.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.029+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd34074410 con 0x7efd3406b820 2024-01-27T13:33:04.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.269+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efd2404d440 con 0x7efd3406b820 2024-01-27T13:33:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.269+0000 7efd1bfff640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efd2006af20 0x7efd2006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.269+0000 7efd32ffd640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efd2006af20 0x7efd2006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.270+0000 7efd32ffd640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efd2006af20 0x7efd2006d3e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd3406c8b0 tx=0x7efd28007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:04.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.272+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd2407a700 con 0x7efd3406b820 2024-01-27T13:33:04.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.283+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efd24076a40 con 0x7efd3406b820 2024-01-27T13:33:04.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.461+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd340c8890 con 0x7efd3406b820 2024-01-27T13:33:04.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.466+0000 7efd1bfff640 1 -- 172.21.15.46:0/1465959034 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd240350a0 con 0x7efd3406b820 2024-01-27T13:33:04.458 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T13:33:04.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efd2006af20 msgr2=0x7efd2006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efd2006af20 0x7efd2006d3e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd3406c8b0 tx=0x7efd28007d30 comp rx=0 tx=0).stop 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 msgr2=0x7efd34154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd34154090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd24033000 tx=0x7efd240046c0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 shutdown_connections 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7efd2006af20 0x7efd2006d3e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd3415d990 0x7efd3415bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7efd340c7d70 0x7efd34157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 --2- 172.21.15.46:0/1465959034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd3406b820 0x7efd34154090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 >> 172.21.15.46:0/1465959034 conn(0x7efd340663a0 msgr2=0x7efd341525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 shutdown_connections 2024-01-27T13:33:04.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.468+0000 7efd39e99640 1 -- 172.21.15.46:0/1465959034 wait complete. 2024-01-27T13:33:04.472 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T13:33:04.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.584+0000 7f70bceda640 1 Processor -- start 2024-01-27T13:33:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.584+0000 7f70bceda640 1 -- start start 2024-01-27T13:33:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.585+0000 7f70bceda640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f70b8153ca0 0x7f70b80c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.585+0000 7f70bceda640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c5b00 0x7f70b80c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.585+0000 7f70bceda640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b815a280 con 0x7f70b80c4750 2024-01-27T13:33:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.585+0000 7f70bceda640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80c6750 con 0x7f70b8153ca0 2024-01-27T13:33:04.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.585+0000 7f70bceda640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815a790 con 0x7f70b80c5b00 2024-01-27T13:33:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.586+0000 7f70b5d9b640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f70b80c4750 0x7f70b806bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58656/0 (socket says 172.21.15.46:58656) 2024-01-27T13:33:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.586+0000 7f70b5d9b640 1 -- 172.21.15.46:0/2275993908 learned_addr learned my addr 172.21.15.46:0/2275993908 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.586+0000 7f70b659c640 1 --2- 172.21.15.46:0/2275993908 >> v2:172.21.15.78:3300/0 conn(0x7f70b8153ca0 0x7f70b80c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.586+0000 7f70b6d9d640 1 --2- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c5b00 0x7f70b80c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.588+0000 7f70b559a640 1 -- 172.21.15.46:0/2275993908 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992144164 0 0) 0x7f70b815a280 con 0x7f70b80c4750 2024-01-27T13:33:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.588+0000 7f70b559a640 1 -- 172.21.15.46:0/2275993908 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a4003520 con 0x7f70b80c4750 2024-01-27T13:33:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.588+0000 7f70b659c640 1 -- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c5b00 msgr2=0x7f70b80c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.588+0000 7f70b659c640 1 --2- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c5b00 0x7f70b80c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.588+0000 7f70b659c640 1 -- 172.21.15.46:0/2275993908 >> v1:172.21.15.46:6789/0 conn(0x7f70b80c4750 legacy=0x7f70b806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.588+0000 7f70b659c640 1 -- 172.21.15.46:0/2275993908 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b815a4b0 con 0x7f70b8153ca0 2024-01-27T13:33:04.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.590+0000 7f70b659c640 1 --2- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b80c41b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70b00097a0 tx=0x7f70b002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe68c53b273a4ccc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:04.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.594+0000 7f70b559a640 1 -- 172.21.15.46:0/2275993908 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0030610 con 0x7f70b8153ca0 2024-01-27T13:33:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.594+0000 7f70b559a640 1 -- 172.21.15.46:0/2275993908 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0030770 con 0x7f70b8153ca0 2024-01-27T13:33:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.594+0000 7f70b559a640 1 -- 172.21.15.46:0/2275993908 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0030b00 con 0x7f70b8153ca0 2024-01-27T13:33:04.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 -- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 msgr2=0x7f70b80c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 --2- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b80c41b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f70b00097a0 tx=0x7f70b002b960 comp rx=0 tx=0).stop 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 -- 172.21.15.46:0/2275993908 shutdown_connections 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 --2- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c5b00 0x7f70b80c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 --2- 172.21.15.46:0/2275993908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b80c41b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 -- 172.21.15.46:0/2275993908 >> 172.21.15.46:0/2275993908 conn(0x7f70b80cf230 msgr2=0x7f70b80cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 -- 172.21.15.46:0/2275993908 shutdown_connections 2024-01-27T13:33:04.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.595+0000 7f70bceda640 1 -- 172.21.15.46:0/2275993908 wait complete. 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.596+0000 7f70bceda640 1 Processor -- start 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.596+0000 7f70bceda640 1 -- start start 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70bceda640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c4750 0x7f70b8154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70bceda640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 0x7f70b8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70bceda640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b81e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70bceda640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8156280 con 0x7f70b80c5b00 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70bceda640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81f43d0 con 0x7f70b8153ca0 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70bceda640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8156bd0 con 0x7f70b80c4750 2024-01-27T13:33:04.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.597+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 0x7f70b8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.598+0000 7f70b5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 0x7f70b8154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38194/0 (socket says 172.21.15.46:38194) 2024-01-27T13:33:04.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.598+0000 7f70b5d9b640 1 -- 172.21.15.46:0/4019331800 learned_addr learned my addr 172.21.15.46:0/4019331800 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:04.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.598+0000 7f70b659c640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c4750 0x7f70b8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.598+0000 7f70b6d9d640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b81e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.601+0000 7f70b5d9b640 1 -- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c4750 msgr2=0x7f70b8154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.601+0000 7f70b5d9b640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c4750 0x7f70b8154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.601+0000 7f70b5d9b640 1 -- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 msgr2=0x7f70b81e35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.601+0000 7f70b5d9b640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b81e35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:04.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.601+0000 7f70b5d9b640 1 -- 172.21.15.46:0/4019331800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009400 con 0x7f70b80c5b00 2024-01-27T13:33:04.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.603+0000 7f70b5d9b640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 0x7f70b8154d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c390 tx=0x7f70a000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:04.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.607+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005ce0 con 0x7f70b80c5b00 2024-01-27T13:33:04.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.607+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0005e40 con 0x7f70b80c5b00 2024-01-27T13:33:04.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.607+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b8156eb0 con 0x7f70b80c5b00 2024-01-27T13:33:04.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.607+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00072f0 con 0x7f70b80c5b00 2024-01-27T13:33:04.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.607+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b80ce3a0 con 0x7f70b80c5b00 2024-01-27T13:33:04.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.608+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b8154170 con 0x7f70b80c5b00 2024-01-27T13:33:04.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.627+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f70a0007450 con 0x7f70b80c5b00 2024-01-27T13:33:04.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.627+0000 7f70aeffd640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f709806af20 0x7f709806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:04.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.627+0000 7f70b659c640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f709806af20 0x7f709806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:04.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.627+0000 7f70b659c640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f709806af20 0x7f709806d3e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f70b0036000 tx=0x7f70b0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:04.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.629+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70a0013e70 con 0x7f70b80c5b00 2024-01-27T13:33:04.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:04.878+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f70a0053e20 con 0x7f70b80c5b00 2024-01-27T13:33:05.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.057+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f70b8154550 con 0x7f70b80c5b00 2024-01-27T13:33:05.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.063+0000 7f70aeffd640 1 -- 172.21.15.46:0/4019331800 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f70b8154550 con 0x7f70b80c5b00 2024-01-27T13:33:05.056 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:33:05.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f709806af20 msgr2=0x7f709806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f709806af20 0x7f709806d3e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f70b0036000 tx=0x7f70b0008030 comp rx=0 tx=0).stop 2024-01-27T13:33:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 msgr2=0x7f70b8154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 0x7f70b8154d70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c390 tx=0x7f70a000c850 comp rx=0 tx=0).stop 2024-01-27T13:33:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 shutdown_connections 2024-01-27T13:33:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f709806af20 0x7f709806d3e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70b8153ca0 0x7f70b81e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70b80c5b00 0x7f70b8154d70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 --2- 172.21.15.46:0/4019331800 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f70b80c4750 0x7f70b8154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 >> 172.21.15.46:0/4019331800 conn(0x7f70b80cf230 msgr2=0x7f70b80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 shutdown_connections 2024-01-27T13:33:05.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.065+0000 7f70bceda640 1 -- 172.21.15.46:0/4019331800 wait complete. 2024-01-27T13:33:05.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:33:05.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.178+0000 7f35fb95a640 1 Processor -- start 2024-01-27T13:33:05.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.178+0000 7f35fb95a640 1 -- start start 2024-01-27T13:33:05.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.179+0000 7f35fb95a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f35f415d990 0x7f35f406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.179+0000 7f35fb95a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f406c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.179+0000 7f35fb95a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f406c9a0 con 0x7f35f406b820 2024-01-27T13:33:05.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.179+0000 7f35fb95a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f406c140 con 0x7f35f415d990 2024-01-27T13:33:05.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.179+0000 7f35fb95a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f415d500 con 0x7f35f40c7d70 2024-01-27T13:33:05.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.180+0000 7f35f8ef5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f35f415d990 0x7f35f406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.180+0000 7f35f9ef7640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.180+0000 7f35f96f6640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f35f406b820 0x7f35f4159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58662/0 (socket says 172.21.15.46:58662) 2024-01-27T13:33:05.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.180+0000 7f35f96f6640 1 -- 172.21.15.46:0/4255212927 learned_addr learned my addr 172.21.15.46:0/4255212927 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:05.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.182+0000 7f35f9ef7640 1 -- 172.21.15.46:0/4255212927 >> v2:172.21.15.46:3300/0 conn(0x7f35f415d990 msgr2=0x7f35f406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:05.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.182+0000 7f35f9ef7640 1 --2- 172.21.15.46:0/4255212927 >> v2:172.21.15.46:3300/0 conn(0x7f35f415d990 0x7f35f406bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.182+0000 7f35f9ef7640 1 -- 172.21.15.46:0/4255212927 >> v1:172.21.15.46:6789/0 conn(0x7f35f406b820 legacy=0x7f35f4159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.182+0000 7f35f9ef7640 1 -- 172.21.15.46:0/4255212927 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40c7b50 con 0x7f35f40c7d70 2024-01-27T13:33:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.184+0000 7f35f9ef7640 1 --2- 172.21.15.46:0/4255212927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f406c460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009d90 tx=0x7f35e402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2f2c5a9358d6ad server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:05.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.188+0000 7f35f3fff640 1 -- 172.21.15.46:0/4255212927 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e402cce0 con 0x7f35f40c7d70 2024-01-27T13:33:05.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.188+0000 7f35f3fff640 1 -- 172.21.15.46:0/4255212927 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e402ce40 con 0x7f35f40c7d70 2024-01-27T13:33:05.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.188+0000 7f35f3fff640 1 -- 172.21.15.46:0/4255212927 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4034660 con 0x7f35f40c7d70 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 -- 172.21.15.46:0/4255212927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 msgr2=0x7f35f406c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 --2- 172.21.15.46:0/4255212927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f406c460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009d90 tx=0x7f35e402bf30 comp rx=0 tx=0).stop 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 -- 172.21.15.46:0/4255212927 shutdown_connections 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 --2- 172.21.15.46:0/4255212927 >> v2:172.21.15.46:3300/0 conn(0x7f35f415d990 0x7f35f406bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 --2- 172.21.15.46:0/4255212927 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f406c460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 -- 172.21.15.46:0/4255212927 >> 172.21.15.46:0/4255212927 conn(0x7f35f40663a0 msgr2=0x7f35f40667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:05.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 -- 172.21.15.46:0/4255212927 shutdown_connections 2024-01-27T13:33:05.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.189+0000 7f35fb95a640 1 -- 172.21.15.46:0/4255212927 wait complete. 2024-01-27T13:33:05.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.190+0000 7f35fb95a640 1 Processor -- start 2024-01-27T13:33:05.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.190+0000 7f35fb95a640 1 -- start start 2024-01-27T13:33:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35fb95a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f406b820 0x7f35f40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35fb95a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35fb95a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 0x7f35f414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35fb95a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f415b410 con 0x7f35f415d990 2024-01-27T13:33:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35fb95a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f4158380 con 0x7f35f406b820 2024-01-27T13:33:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35fb95a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f41577b0 con 0x7f35f40c7d70 2024-01-27T13:33:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35f9ef7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 0x7f35f414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35f8ef5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35f96f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f406b820 0x7f35f40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35f9ef7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 0x7f35f414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38208/0 (socket says 172.21.15.46:38208) 2024-01-27T13:33:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.191+0000 7f35f9ef7640 1 -- 172.21.15.46:0/912826903 learned_addr learned my addr 172.21.15.46:0/912826903 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:05.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.195+0000 7f35f8ef5640 1 -- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f406b820 msgr2=0x7f35f40cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.195+0000 7f35f8ef5640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f406b820 0x7f35f40cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.195+0000 7f35f8ef5640 1 -- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 msgr2=0x7f35f414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.195+0000 7f35f8ef5640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 0x7f35f414d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.195+0000 7f35f8ef5640 1 -- 172.21.15.46:0/912826903 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e4009a70 con 0x7f35f40c7d70 2024-01-27T13:33:05.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.195+0000 7f35f9ef7640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 0x7f35f414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:33:05.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.197+0000 7f35f8ef5640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f414d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35e800e8a0 tx=0x7f35e800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:05.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.200+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8009e60 con 0x7f35f40c7d70 2024-01-27T13:33:05.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.200+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e800c940 con 0x7f35f40c7d70 2024-01-27T13:33:05.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.200+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e800ccd0 con 0x7f35f40c7d70 2024-01-27T13:33:05.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.201+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f41592e0 con 0x7f35f40c7d70 2024-01-27T13:33:05.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.201+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f4157d30 con 0x7f35f40c7d70 2024-01-27T13:33:05.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.202+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f414cde0 con 0x7f35f40c7d70 2024-01-27T13:33:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.443+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f35e8013470 con 0x7f35f40c7d70 2024-01-27T13:33:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.444+0000 7f35f1ffb640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f35e006af20 0x7f35e006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.444+0000 7f35f96f6640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f35e006af20 0x7f35e006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.444+0000 7f35f96f6640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f35e006af20 0x7f35e006d3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f35ec007fd0 tx=0x7f35ec007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:05.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.446+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35e8058a00 con 0x7f35f40c7d70 2024-01-27T13:33:05.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.457+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f35e8054d40 con 0x7f35f40c7d70 2024-01-27T13:33:05.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.674+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35f4074410 con 0x7f35f40c7d70 2024-01-27T13:33:05.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.687+0000 7f35f1ffb640 1 -- 172.21.15.46:0/912826903 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6514 (secure 0 0 0) 0x7f35e8021090 con 0x7f35f40c7d70 2024-01-27T13:33:05.679 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:33:05.679 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:45.974762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T13:33:05.679 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-01-27T13:33:05.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f35e006af20 msgr2=0x7f35e006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f35e006af20 0x7f35e006d3e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f35ec007fd0 tx=0x7f35ec007e80 comp rx=0 tx=0).stop 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 msgr2=0x7f35f414d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f414d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35e800e8a0 tx=0x7f35e800ed60 comp rx=0 tx=0).stop 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 shutdown_connections 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f35e006af20 0x7f35e006d3e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f415d990 0x7f35f414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f35f40c7d70 0x7f35f414d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 --2- 172.21.15.46:0/912826903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f406b820 0x7f35f40cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 >> 172.21.15.46:0/912826903 conn(0x7f35f40663a0 msgr2=0x7f35f4070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 shutdown_connections 2024-01-27T13:33:05.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.688+0000 7f35fb95a640 1 -- 172.21.15.46:0/912826903 wait complete. 2024-01-27T13:33:05.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:33:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.800+0000 7f8d9e1c5640 1 Processor -- start 2024-01-27T13:33:05.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.800+0000 7f8d9e1c5640 1 -- start start 2024-01-27T13:33:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d9e1c5640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d980c9130 0x7f8d98158010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d9e1c5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d980cce20 0x7f8d980cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d9e1c5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d98158550 con 0x7f8d98151a10 2024-01-27T13:33:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d9e1c5640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9815bb10 con 0x7f8d980c9130 2024-01-27T13:33:05.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d9e1c5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9815ab00 con 0x7f8d980cce20 2024-01-27T13:33:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d96ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f8d980c9130 0x7f8d98158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d97fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d980cce20 0x7f8d980cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d977fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d98151a10 0x7f8d980c1eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:47790/0 (socket says 172.21.15.46:47790) 2024-01-27T13:33:05.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.801+0000 7f8d977fe640 1 -- 172.21.15.46:0/2669994920 learned_addr learned my addr 172.21.15.46:0/2669994920 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.803+0000 7f8d967fc640 1 -- 172.21.15.46:0/2669994920 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594762069 0 0) 0x7f8d88001110 con 0x7f8d98151a10 2024-01-27T13:33:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.803+0000 7f8d967fc640 1 -- 172.21.15.46:0/2669994920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d80003520 con 0x7f8d98151a10 2024-01-27T13:33:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.804+0000 7f8d97fff640 1 -- 172.21.15.46:0/2669994920 >> v2:172.21.15.46:3300/0 conn(0x7f8d980c9130 msgr2=0x7f8d98158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.804+0000 7f8d97fff640 1 --2- 172.21.15.46:0/2669994920 >> v2:172.21.15.46:3300/0 conn(0x7f8d980c9130 0x7f8d98158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.804+0000 7f8d97fff640 1 -- 172.21.15.46:0/2669994920 >> v1:172.21.15.78:6789/0 conn(0x7f8d98151a10 legacy=0x7f8d980c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.804+0000 7f8d97fff640 1 -- 172.21.15.46:0/2669994920 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980c8140 con 0x7f8d980cce20 2024-01-27T13:33:05.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.808+0000 7f8d97fff640 1 --2- 172.21.15.46:0/2669994920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d980cce20 0x7f8d980cd2b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009d90 tx=0x7f8d9002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b375fe5041417a0b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d967fc640 1 -- 172.21.15.46:0/2669994920 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9002cce0 con 0x7f8d980cce20 2024-01-27T13:33:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d967fc640 1 -- 172.21.15.46:0/2669994920 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9002ce40 con 0x7f8d980cce20 2024-01-27T13:33:05.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d967fc640 1 -- 172.21.15.46:0/2669994920 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90034660 con 0x7f8d980cce20 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/2669994920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d980cce20 msgr2=0x7f8d980cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/2669994920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d980cce20 0x7f8d980cd2b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009d90 tx=0x7f8d9002bf30 comp rx=0 tx=0).stop 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/2669994920 shutdown_connections 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/2669994920 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d980cce20 0x7f8d980cd2b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/2669994920 >> v2:172.21.15.46:3300/0 conn(0x7f8d980c9130 0x7f8d98158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/2669994920 >> 172.21.15.46:0/2669994920 conn(0x7f8d980663a0 msgr2=0x7f8d980667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/2669994920 shutdown_connections 2024-01-27T13:33:05.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.812+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/2669994920 wait complete. 2024-01-27T13:33:05.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 Processor -- start 2024-01-27T13:33:05.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 -- start start 2024-01-27T13:33:05.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d980c9130 0x7f8d980b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 0x7f8d980b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d98151a10 0x7f8d98147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9814af00 con 0x7f8d980cce20 2024-01-27T13:33:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980afcc0 con 0x7f8d980c9130 2024-01-27T13:33:05.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.814+0000 7f8d9e1c5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d981494f0 con 0x7f8d98151a10 2024-01-27T13:33:05.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.815+0000 7f8d96ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 0x7f8d980b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.815+0000 7f8d97fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d98151a10 0x7f8d98147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.815+0000 7f8d977fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d980c9130 0x7f8d980b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:05.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.815+0000 7f8d96ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 0x7f8d980b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38236/0 (socket says 172.21.15.46:38236) 2024-01-27T13:33:05.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.815+0000 7f8d96ffd640 1 -- 172.21.15.46:0/788966798 learned_addr learned my addr 172.21.15.46:0/788966798 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:05.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.819+0000 7f8d96ffd640 1 -- 172.21.15.46:0/788966798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d98151a10 msgr2=0x7f8d98147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.819+0000 7f8d96ffd640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d98151a10 0x7f8d98147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.819+0000 7f8d96ffd640 1 -- 172.21.15.46:0/788966798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d980c9130 msgr2=0x7f8d980b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:05.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.819+0000 7f8d96ffd640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d980c9130 0x7f8d980b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:05.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.819+0000 7f8d96ffd640 1 -- 172.21.15.46:0/788966798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90009a70 con 0x7f8d980cce20 2024-01-27T13:33:05.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.821+0000 7f8d96ffd640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 0x7f8d980b1ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00e870 tx=0x7f8d8c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.824+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c0094f0 con 0x7f8d980cce20 2024-01-27T13:33:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.824+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c00c8e0 con 0x7f8d980cce20 2024-01-27T13:33:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.824+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c00cc90 con 0x7f8d980cce20 2024-01-27T13:33:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.825+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d98158c30 con 0x7f8d980cce20 2024-01-27T13:33:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.825+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9814a560 con 0x7f8d980cce20 2024-01-27T13:33:05.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:05.825+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980c7580 con 0x7f8d980cce20 2024-01-27T13:33:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.087+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8d8c013470 con 0x7f8d980cce20 2024-01-27T13:33:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.088+0000 7f8d7ffff640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8d8406af50 0x7f8d8406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.088+0000 7f8d977fe640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8d8406af50 0x7f8d8406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.088+0000 7f8d977fe640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8d8406af50 0x7f8d8406d410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005880 tx=0x7f8d88009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:06.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.102+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8d8c058a60 con 0x7f8d980cce20 2024-01-27T13:33:06.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.102+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8d8c054da0 con 0x7f8d980cce20 2024-01-27T13:33:06.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.284+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d98074410 con 0x7f8d980cce20 2024-01-27T13:33:06.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.337+0000 7f8d7ffff640 1 -- 172.21.15.46:0/788966798 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f8d8c021090 con 0x7f8d980cce20 2024-01-27T13:33:06.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:33:06.330 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:33:06.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8d8406af50 msgr2=0x7f8d8406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8d8406af50 0x7f8d8406d410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005880 tx=0x7f8d88009040 comp rx=0 tx=0).stop 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 msgr2=0x7f8d980b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 0x7f8d980b1ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00e870 tx=0x7f8d8c00ed30 comp rx=0 tx=0).stop 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 shutdown_connections 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f8d8406af50 0x7f8d8406d410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f8d98151a10 0x7f8d98147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d980cce20 0x7f8d980b1ae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 --2- 172.21.15.46:0/788966798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d980c9130 0x7f8d980b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 >> 172.21.15.46:0/788966798 conn(0x7f8d980663a0 msgr2=0x7f8d980c2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 shutdown_connections 2024-01-27T13:33:06.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.339+0000 7f8d9e1c5640 1 -- 172.21.15.46:0/788966798 wait complete. 2024-01-27T13:33:06.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T13:33:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 Processor -- start 2024-01-27T13:33:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 -- start start 2024-01-27T13:33:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb93c156fc0 0x7fb93c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb93c0c7f10 0x7fb93c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c15cf70 con 0x7fb93c0717e0 2024-01-27T13:33:06.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c1573a0 con 0x7fb93c156fc0 2024-01-27T13:33:06.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.455+0000 7fb94170e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c06c520 con 0x7fb93c0c7f10 2024-01-27T13:33:06.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.456+0000 7fb93b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb93c0c7f10 0x7fb93c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.456+0000 7fb93affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fb93c156fc0 0x7fb93c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.456+0000 7fb933fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fb93c0717e0 0x7fb93c0c7800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58672/0 (socket says 172.21.15.46:58672) 2024-01-27T13:33:06.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.456+0000 7fb933fff640 1 -- 172.21.15.46:0/2715350858 learned_addr learned my addr 172.21.15.46:0/2715350858 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:06.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.458+0000 7fb93b7fe640 1 -- 172.21.15.46:0/2715350858 >> v2:172.21.15.46:3300/0 conn(0x7fb93c156fc0 msgr2=0x7fb93c0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:06.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.458+0000 7fb93b7fe640 1 --2- 172.21.15.46:0/2715350858 >> v2:172.21.15.46:3300/0 conn(0x7fb93c156fc0 0x7fb93c0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.458+0000 7fb93b7fe640 1 -- 172.21.15.46:0/2715350858 >> v1:172.21.15.46:6789/0 conn(0x7fb93c0717e0 legacy=0x7fb93c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.458+0000 7fb93b7fe640 1 -- 172.21.15.46:0/2715350858 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c06c800 con 0x7fb93c0c7f10 2024-01-27T13:33:06.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.460+0000 7fb93b7fe640 1 --2- 172.21.15.46:0/2715350858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c0c7f10 0x7fb93c15d400 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06c000 tx=0x7fb93402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53036b1abeceac8 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.464+0000 7fb93a7fc640 1 -- 172.21.15.46:0/2715350858 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93402cc80 con 0x7fb93c0c7f10 2024-01-27T13:33:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.464+0000 7fb93a7fc640 1 -- 172.21.15.46:0/2715350858 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93402cde0 con 0x7fb93c0c7f10 2024-01-27T13:33:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.464+0000 7fb93a7fc640 1 -- 172.21.15.46:0/2715350858 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934034660 con 0x7fb93c0c7f10 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 -- 172.21.15.46:0/2715350858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c0c7f10 msgr2=0x7fb93c15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 --2- 172.21.15.46:0/2715350858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c0c7f10 0x7fb93c15d400 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb93c06c000 tx=0x7fb93402bed0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 -- 172.21.15.46:0/2715350858 shutdown_connections 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 --2- 172.21.15.46:0/2715350858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c0c7f10 0x7fb93c15d400 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 --2- 172.21.15.46:0/2715350858 >> v2:172.21.15.46:3300/0 conn(0x7fb93c156fc0 0x7fb93c0712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 -- 172.21.15.46:0/2715350858 >> 172.21.15.46:0/2715350858 conn(0x7fb93c06f310 msgr2=0x7fb93c06f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 -- 172.21.15.46:0/2715350858 shutdown_connections 2024-01-27T13:33:06.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.465+0000 7fb94170e640 1 -- 172.21.15.46:0/2715350858 wait complete. 2024-01-27T13:33:06.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.466+0000 7fb94170e640 1 Processor -- start 2024-01-27T13:33:06.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.466+0000 7fb94170e640 1 -- start start 2024-01-27T13:33:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb94170e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb93c0717e0 0x7fb93c1f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb94170e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 0x7fb93c0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb94170e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c156fc0 0x7fb93c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb94170e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c1560f0 con 0x7fb93c0c7f10 2024-01-27T13:33:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb94170e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0cac60 con 0x7fb93c156fc0 2024-01-27T13:33:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb94170e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0c4ef0 con 0x7fb93c0717e0 2024-01-27T13:33:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb933fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 0x7fb93c0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb933fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 0x7fb93c0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38260/0 (socket says 172.21.15.46:38260) 2024-01-27T13:33:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb933fff640 1 -- 172.21.15.46:0/1427720038 learned_addr learned my addr 172.21.15.46:0/1427720038 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb93b7fe640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c156fc0 0x7fb93c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.467+0000 7fb93affd640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb93c0717e0 0x7fb93c1f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.471+0000 7fb933fff640 1 -- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb93c0717e0 msgr2=0x7fb93c1f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.471+0000 7fb933fff640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb93c0717e0 0x7fb93c1f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.471+0000 7fb933fff640 1 -- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c156fc0 msgr2=0x7fb93c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.471+0000 7fb933fff640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c156fc0 0x7fb93c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.471+0000 7fb933fff640 1 -- 172.21.15.46:0/1427720038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934009a70 con 0x7fb93c0c7f10 2024-01-27T13:33:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.473+0000 7fb933fff640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 0x7fb93c0c49b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb92400c3f0 tx=0x7fb92400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.477+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924005ce0 con 0x7fb93c0c7f10 2024-01-27T13:33:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.477+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb924005e40 con 0x7fb93c0c7f10 2024-01-27T13:33:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.477+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c156340 con 0x7fb93c0c7f10 2024-01-27T13:33:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.477+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240072f0 con 0x7fb93c0c7f10 2024-01-27T13:33:06.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.477+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c0caeb0 con 0x7fb93c0c7f10 2024-01-27T13:33:06.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.478+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c074410 con 0x7fb93c0c7f10 2024-01-27T13:33:06.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.497+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb924007450 con 0x7fb93c0c7f10 2024-01-27T13:33:06.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.497+0000 7fb9337fe640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91c06af20 0x7fb91c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:06.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.498+0000 7fb93affd640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91c06af20 0x7fb91c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:06.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.498+0000 7fb93affd640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91c06af20 0x7fb91c06d3e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009b40 tx=0x7fb92c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.500+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb924013e70 con 0x7fb93c0c7f10 2024-01-27T13:33:06.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.750+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb924053f10 con 0x7fb93c0c7f10 2024-01-27T13:33:06.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.970+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb93c071390 con 0x7fb93c0c7f10 2024-01-27T13:33:06.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.994+0000 7fb9337fe640 1 -- 172.21.15.46:0/1427720038 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6514 (secure 0 0 0) 0x7fb924057530 con 0x7fb93c0c7f10 2024-01-27T13:33:06.986 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:33:06.987 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:45.974762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T13:33:06.987 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-01-27T13:33:06.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91c06af20 msgr2=0x7fb91c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91c06af20 0x7fb91c06d3e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009b40 tx=0x7fb92c009190 comp rx=0 tx=0).stop 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 msgr2=0x7fb93c0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 0x7fb93c0c49b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb92400c3f0 tx=0x7fb92400c8b0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 shutdown_connections 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fb91c06af20 0x7fb91c06d3e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb93c156fc0 0x7fb93c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb93c0c7f10 0x7fb93c0c49b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 --2- 172.21.15.46:0/1427720038 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fb93c0717e0 0x7fb93c1f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 >> 172.21.15.46:0/1427720038 conn(0x7fb93c06f310 msgr2=0x7fb93c0ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 shutdown_connections 2024-01-27T13:33:06.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:06.996+0000 7fb94170e640 1 -- 172.21.15.46:0/1427720038 wait complete. 2024-01-27T13:33:07.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-27T13:32:13.208332+0000', 'modified': '2024-01-27T13:32:45.974762+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.46:6837/3746495433', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6836', 'nonce': 3746495433}, {'type': 'v1', 'addr': '172.21.15.46:6837', 'nonce': 3746495433}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-27T13:33:07.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-27T13:33:07.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-01-27T13:33:07.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.716+0000 7fcb78543640 1 Processor -- start 2024-01-27T13:33:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.716+0000 7fcb78543640 1 -- start start 2024-01-27T13:33:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.717+0000 7fcb78543640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb700c8f00 0x7fcb700cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.717+0000 7fcb78543640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fcb700cf550 0x7fcb700cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.717+0000 7fcb78543640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb700ca9f0 con 0x7fcb700c92e0 2024-01-27T13:33:07.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.717+0000 7fcb78543640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700cc9c0 con 0x7fcb700cf550 2024-01-27T13:33:07.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.717+0000 7fcb78543640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb70159d50 con 0x7fcb700c8f00 2024-01-27T13:33:07.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.718+0000 7fcb762df640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcb700c8f00 0x7fcb700cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.718+0000 7fcb75ade640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fcb700c92e0 0x7fcb7015cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58674/0 (socket says 172.21.15.46:58674) 2024-01-27T13:33:07.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.718+0000 7fcb75ade640 1 -- 172.21.15.46:0/2452717683 learned_addr learned my addr 172.21.15.46:0/2452717683 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:07.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.718+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/2452717683 >> v2:172.21.15.46:3300/0 conn(0x7fcb700cf550 0x7fcb700cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.720+0000 7fcb762df640 1 -- 172.21.15.46:0/2452717683 >> v2:172.21.15.46:3300/0 conn(0x7fcb700cf550 msgr2=0x7fcb700cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.720+0000 7fcb762df640 1 --2- 172.21.15.46:0/2452717683 >> v2:172.21.15.46:3300/0 conn(0x7fcb700cf550 0x7fcb700cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.720+0000 7fcb762df640 1 -- 172.21.15.46:0/2452717683 >> v1:172.21.15.46:6789/0 conn(0x7fcb700c92e0 legacy=0x7fcb7015cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.720+0000 7fcb762df640 1 -- 172.21.15.46:0/2452717683 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700cc6e0 con 0x7fcb700c8f00 2024-01-27T13:33:07.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.722+0000 7fcb762df640 1 --2- 172.21.15.46:0/2452717683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb700cf010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcb700d01c0 tx=0x7fcb6c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa188c14db00250 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.726+0000 7fcb752dd640 1 -- 172.21.15.46:0/2452717683 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c030610 con 0x7fcb700c8f00 2024-01-27T13:33:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.726+0000 7fcb752dd640 1 -- 172.21.15.46:0/2452717683 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c030770 con 0x7fcb700c8f00 2024-01-27T13:33:07.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.726+0000 7fcb752dd640 1 -- 172.21.15.46:0/2452717683 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c030b00 con 0x7fcb700c8f00 2024-01-27T13:33:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.726+0000 7fcb78543640 1 -- 172.21.15.46:0/2452717683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 msgr2=0x7fcb700cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.726+0000 7fcb78543640 1 --2- 172.21.15.46:0/2452717683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb700cf010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcb700d01c0 tx=0x7fcb6c02b960 comp rx=0 tx=0).stop 2024-01-27T13:33:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.727+0000 7fcb78543640 1 -- 172.21.15.46:0/2452717683 shutdown_connections 2024-01-27T13:33:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.727+0000 7fcb78543640 1 --2- 172.21.15.46:0/2452717683 >> v2:172.21.15.46:3300/0 conn(0x7fcb700cf550 0x7fcb700cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.727+0000 7fcb78543640 1 --2- 172.21.15.46:0/2452717683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb700cf010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.727+0000 7fcb78543640 1 -- 172.21.15.46:0/2452717683 >> 172.21.15.46:0/2452717683 conn(0x7fcb7008afd0 msgr2=0x7fcb7008b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.727+0000 7fcb78543640 1 -- 172.21.15.46:0/2452717683 shutdown_connections 2024-01-27T13:33:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.727+0000 7fcb78543640 1 -- 172.21.15.46:0/2452717683 wait complete. 2024-01-27T13:33:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.728+0000 7fcb78543640 1 Processor -- start 2024-01-27T13:33:07.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.728+0000 7fcb78543640 1 -- start start 2024-01-27T13:33:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb78543640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb701e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb78543640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb700c92e0 0x7fcb701eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb78543640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb700cf550 0x7fcb701592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb78543640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701e3360 con 0x7fcb700cf550 2024-01-27T13:33:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb78543640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701e2200 con 0x7fcb700c8f00 2024-01-27T13:33:07.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb78543640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb701e1c40 con 0x7fcb700c92e0 2024-01-27T13:33:07.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb76ae0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb700cf550 0x7fcb701592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb75ade640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb700c92e0 0x7fcb701eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb762df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb701e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb76ae0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb700cf550 0x7fcb701592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38276/0 (socket says 172.21.15.46:38276) 2024-01-27T13:33:07.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.729+0000 7fcb76ae0640 1 -- 172.21.15.46:0/3972532087 learned_addr learned my addr 172.21.15.46:0/3972532087 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.733+0000 7fcb75ade640 1 -- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 msgr2=0x7fcb701e2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.733+0000 7fcb75ade640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb701e2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.733+0000 7fcb75ade640 1 -- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb700cf550 msgr2=0x7fcb701592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.733+0000 7fcb75ade640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb700cf550 0x7fcb701592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.733+0000 7fcb75ade640 1 -- 172.21.15.46:0/3972532087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c009400 con 0x7fcb700c92e0 2024-01-27T13:33:07.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.735+0000 7fcb75ade640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb700c92e0 0x7fcb701eeff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb700c96c0 tx=0x7fcb6000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.738+0000 7fcb66ffd640 1 -- 172.21.15.46:0/3972532087 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60005ce0 con 0x7fcb700c92e0 2024-01-27T13:33:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.739+0000 7fcb66ffd640 1 -- 172.21.15.46:0/3972532087 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60005e40 con 0x7fcb700c92e0 2024-01-27T13:33:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.739+0000 7fcb66ffd640 1 -- 172.21.15.46:0/3972532087 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60007310 con 0x7fcb700c92e0 2024-01-27T13:33:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.739+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb701e1f20 con 0x7fcb700c92e0 2024-01-27T13:33:07.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.739+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb701f29c0 con 0x7fcb700c92e0 2024-01-27T13:33:07.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 Processor -- start 2024-01-27T13:33:07.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 -- start start 2024-01-27T13:33:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f2efa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f2ee750 0x56390f330670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f32ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f25d030 con 0x56390f32fcb0 2024-01-27T13:33:07.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f25a720 con 0x56390f2ee750 2024-01-27T13:33:07.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.742+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x56390f256010 con 0x56390f330090 2024-01-27T13:33:07.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.743+0000 7fcb76ae0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f2efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.743+0000 7fcb762df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f2ee750 0x56390f330670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.743+0000 7fcb76ae0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f2efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38290/0 (socket says 172.21.15.46:38290) 2024-01-27T13:33:07.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.743+0000 7fcb76ae0640 1 -- 172.21.15.46:0/3048053386 learned_addr learned my addr 172.21.15.46:0/3048053386 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.746+0000 7fcb76ae0640 1 -- 172.21.15.46:0/3048053386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 msgr2=0x56390f32ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.746+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f32ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.746+0000 7fcb76ae0640 1 -- 172.21.15.46:0/3048053386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f2ee750 msgr2=0x56390f330670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.746+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f2ee750 0x56390f330670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.746+0000 7fcb76ae0640 1 -- 172.21.15.46:0/3048053386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56390f218680 con 0x56390f32fcb0 2024-01-27T13:33:07.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.747+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f2efa50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb68007360 tx=0x7fcb68007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba756f6dfe25613 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.751+0000 7fcb53fff640 1 -- 172.21.15.46:0/3048053386 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680155f0 con 0x56390f32fcb0 2024-01-27T13:33:07.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.751+0000 7fcb53fff640 1 -- 172.21.15.46:0/3048053386 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68015750 con 0x56390f32fcb0 2024-01-27T13:33:07.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.751+0000 7fcb53fff640 1 -- 172.21.15.46:0/3048053386 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68015ac0 con 0x56390f32fcb0 2024-01-27T13:33:07.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/3048053386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 msgr2=0x56390f2efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f2efa50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb68007360 tx=0x7fcb68007820 comp rx=0 tx=0).stop 2024-01-27T13:33:07.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/3048053386 shutdown_connections 2024-01-27T13:33:07.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f32ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f2ee750 0x56390f330670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/3048053386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f2efa50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/3048053386 >> 172.21.15.46:0/3048053386 conn(0x56390f2eb8c0 msgr2=0x56390f2ef060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/3048053386 shutdown_connections 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.752+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/3048053386 wait complete. 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.753+0000 7fcb7b1e1740 1 -- start start 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.753+0000 7fcb7b1e1740 1 Processor -- start 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f32fcb0 0x56390f335060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 0x56390f32bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f32c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f20f5f0 con 0x56390f330090 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f20f290 con 0x56390f3171a0 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x56390f1d4300 con 0x56390f32fcb0 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb7b1e1740 10 client.0 _ll_register_callbacks cb 0x56390f20a260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb762df640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 0x56390f32bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb762df640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 0x56390f32bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38304/0 (socket says 172.21.15.46:38304) 2024-01-27T13:33:07.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb762df640 1 -- 172.21.15.46:0/992378286 learned_addr learned my addr 172.21.15.46:0/992378286 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:07.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.754+0000 7fcb75ade640 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f32c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.758+0000 7fcb762df640 1 -- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f32fcb0 msgr2=0x56390f335060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.758+0000 7fcb762df640 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f32fcb0 0x56390f335060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.758+0000 7fcb762df640 1 -- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 msgr2=0x56390f32c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.758+0000 7fcb762df640 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f32c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.758+0000 7fcb762df640 1 -- 172.21.15.46:0/992378286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb68011040 con 0x56390f330090 2024-01-27T13:33:07.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.760+0000 7fcb762df640 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 0x56390f32bee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c039680 tx=0x7fcb6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293336111d7c155 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.760+0000 7fcb517fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-27T13:33:07.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.764+0000 7fcb517fa640 1 -- 172.21.15.46:0/992378286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c03e040 con 0x56390f330090 2024-01-27T13:33:07.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.764+0000 7fcb517fa640 1 -- 172.21.15.46:0/992378286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb6c0399f0 con 0x56390f330090 2024-01-27T13:33:07.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.764+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56390f24eea0 con 0x56390f330090 2024-01-27T13:33:07.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.764+0000 7fcb66ffd640 1 -- 172.21.15.46:0/3972532087 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcb60007570 con 0x7fcb700c92e0 2024-01-27T13:33:07.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.765+0000 7fcb66ffd640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fcb5406ae90 0x7fcb5406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.765+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fcb5406ae90 0x7fcb5406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.765+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fcb5406ae90 0x7fcb5406d350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb68018040 tx=0x7fcb68013000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.765+0000 7fcb517fa640 1 -- 172.21.15.46:0/992378286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb6c039bb0 con 0x56390f330090 2024-01-27T13:33:07.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.765+0000 7fcb7b1e1740 10 client.4671 fetch_fsmap learned FSMap version 10 2024-01-27T13:33:07.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.765+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x56390f254690 con 0x56390f330090 2024-01-27T13:33:07.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.767+0000 7fcb66ffd640 1 -- 172.21.15.46:0/3972532087 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb60057bb0 con 0x7fcb700c92e0 2024-01-27T13:33:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.771+0000 7fcb517fa640 1 -- 172.21.15.46:0/992378286 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56390f24eea0 con 0x56390f330090 2024-01-27T13:33:07.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.771+0000 7fcb517fa640 1 -- 172.21.15.46:0/992378286 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fcb6c04c060 con 0x56390f330090 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb7b1e1740 10 client.4671 fetch_fsmap finished waiting for FSMap version 10 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb7b1e1740 10 client.4671 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb7b1e1740 20 client.4671 populate_metadata read hostname 'smithi046' 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f34cae0 0x56390f34eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb7b1e1740 4 client.4671 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 --> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56390f24ebc0 con 0x56390f34cae0 2024-01-27T13:33:07.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.772+0000 7fcb75ade640 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f34cae0 0x56390f34eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.775+0000 7fcb75ade640 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f34cae0 0x56390f34eed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ce530c662366ea4 server_cookie=7e1ff6a3d0750106 in_seq=0 out_seq=0 2024-01-27T13:33:07.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.775+0000 7fcb517fa640 10 client.4671 ms_handle_connect on v2:172.21.15.46:6836/3746495433 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb517fa640 1 -- 172.21.15.46:0/992378286 <== mds.0 v2:172.21.15.46:6836/3746495433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56390f24ebc0 con 0x56390f34cae0 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb517fa640 10 client.4671 handle_command_reply: tid=0 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 client.4671 shutdown 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 msgr2=0x56390f32bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 0x56390f32bee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c039680 tx=0x7fcb6c004730 comp rx=0 tx=0).stop 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 shutdown_connections 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f34cae0 0x56390f34eed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f32c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f330090 0x56390f32bee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/992378286 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f32fcb0 0x56390f335060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb517fa640 0 client.4671 ms_handle_reset on v2:172.21.15.46:6836/3746495433 2024-01-27T13:33:07.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 >> 172.21.15.46:0/992378286 conn(0x56390f2ee750 msgr2=0x56390f2ef7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 shutdown_connections 2024-01-27T13:33:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/992378286 wait complete. 2024-01-27T13:33:07.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.794+0000 7fcb7b1e1740 20 client.4671 trim_cache size 0 max 16384 2024-01-27T13:33:07.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.810+0000 7fcb7b1e1740 1 Processor -- start 2024-01-27T13:33:07.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.810+0000 7fcb7b1e1740 1 -- start start 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f3171a0 0x56390f32bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f32c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f330090 0x56390f32a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f2eaba0 con 0x56390f32fcb0 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f2f0b40 con 0x56390f330090 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x56390f316fb0 con 0x56390f3171a0 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb75ade640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f32c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb76ae0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f330090 0x56390f32a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb762df640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f3171a0 0x56390f32bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb75ade640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f32c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38318/0 (socket says 172.21.15.46:38318) 2024-01-27T13:33:07.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.811+0000 7fcb75ade640 1 -- 172.21.15.46:0/4292289179 learned_addr learned my addr 172.21.15.46:0/4292289179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.814+0000 7fcb75ade640 1 -- 172.21.15.46:0/4292289179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f3171a0 msgr2=0x56390f32bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.814+0000 7fcb75ade640 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f3171a0 0x56390f32bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.814+0000 7fcb75ade640 1 -- 172.21.15.46:0/4292289179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f330090 msgr2=0x56390f32a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.814+0000 7fcb75ade640 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f330090 0x56390f32a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.814+0000 7fcb75ade640 1 -- 172.21.15.46:0/4292289179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56390f1f1390 con 0x56390f32fcb0 2024-01-27T13:33:07.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.815+0000 7fcb75ade640 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f32c420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb60057b40 tx=0x7fcb6001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae9dcfd53b1b22a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.819+0000 7fcb537fe640 1 -- 172.21.15.46:0/4292289179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60055db0 con 0x56390f32fcb0 2024-01-27T13:33:07.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.819+0000 7fcb537fe640 1 -- 172.21.15.46:0/4292289179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6006f070 con 0x56390f32fcb0 2024-01-27T13:33:07.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.819+0000 7fcb537fe640 1 -- 172.21.15.46:0/4292289179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb600542c0 con 0x56390f32fcb0 2024-01-27T13:33:07.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/4292289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 msgr2=0x56390f32c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f32c420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb60057b40 tx=0x7fcb6001e040 comp rx=0 tx=0).stop 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/4292289179 shutdown_connections 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f330090 0x56390f32a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f32c420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/4292289179 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f3171a0 0x56390f32bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/4292289179 >> 172.21.15.46:0/4292289179 conn(0x56390f2ee750 msgr2=0x56390f3370a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/4292289179 shutdown_connections 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.820+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/4292289179 wait complete. 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.821+0000 7fcb7b1e1740 1 -- start start 2024-01-27T13:33:07.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.821+0000 7fcb7b1e1740 1 Processor -- start 2024-01-27T13:33:07.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f312de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f313cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f2ec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f2eebc0 con 0x56390f32fcb0 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x56390f3169e0 con 0x56390f3171a0 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x56390f2ef540 con 0x56390f330090 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb7b1e1740 10 client.0 _ll_register_callbacks cb 0x7fcb68009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb75ade640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f313cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb762df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f312de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb76ae0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f2ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb75ade640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f313cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38322/0 (socket says 172.21.15.46:38322) 2024-01-27T13:33:07.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.822+0000 7fcb75ade640 1 -- 172.21.15.46:0/168511641 learned_addr learned my addr 172.21.15.46:0/168511641 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.825+0000 7fcb75ade640 1 -- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 msgr2=0x56390f2ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.826+0000 7fcb75ade640 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f2ec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.826+0000 7fcb75ade640 1 -- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 msgr2=0x56390f312de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:33:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.826+0000 7fcb75ade640 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f312de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.826+0000 7fcb75ade640 1 -- 172.21.15.46:0/168511641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb701f29c0 con 0x56390f32fcb0 2024-01-27T13:33:07.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.826+0000 7fcb76ae0640 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f2ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T13:33:07.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.828+0000 7fcb75ade640 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f313cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb60005fd0 tx=0x7fcb60014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c754ae1b7395c367 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:07.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.828+0000 7fcb517fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-01-27T13:33:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.831+0000 7fcb517fa640 1 -- 172.21.15.46:0/168511641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6005f970 con 0x56390f32fcb0 2024-01-27T13:33:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.831+0000 7fcb517fa640 1 -- 172.21.15.46:0/168511641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb6005fad0 con 0x56390f32fcb0 2024-01-27T13:33:07.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.831+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb68015750 con 0x56390f32fcb0 2024-01-27T13:33:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.833+0000 7fcb517fa640 1 -- 172.21.15.46:0/168511641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb6007b020 con 0x56390f32fcb0 2024-01-27T13:33:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.833+0000 7fcb7b1e1740 10 client.4677 fetch_fsmap learned FSMap version 10 2024-01-27T13:33:07.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.833+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x56390f216ee0 con 0x56390f32fcb0 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb517fa640 1 -- 172.21.15.46:0/168511641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68015750 con 0x56390f32fcb0 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb517fa640 1 -- 172.21.15.46:0/168511641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fcb600539a0 con 0x56390f32fcb0 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb7b1e1740 10 client.4677 fetch_fsmap finished waiting for FSMap version 10 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb7b1e1740 10 client.4677 resolve_mds: resolved name 'e' to daemon mds.e 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb7b1e1740 20 client.4677 populate_metadata read hostname 'smithi046' 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f342aa0 0x56390f342e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb7b1e1740 4 client.4677 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.837+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 --> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56390ef556c0 con 0x56390f342aa0 2024-01-27T13:33:07.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.838+0000 7fcb762df640 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f342aa0 0x56390f342e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:07.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.840+0000 7fcb762df640 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f342aa0 0x56390f342e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42c633ebb9ddcfaa server_cookie=8322661f0235b404 in_seq=0 out_seq=0 2024-01-27T13:33:07.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.840+0000 7fcb517fa640 10 client.4677 ms_handle_connect on v2:172.21.15.46:6836/3746495433 2024-01-27T13:33:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.843+0000 7fcb517fa640 1 -- 172.21.15.46:0/168511641 <== mds.0 v2:172.21.15.46:6836/3746495433 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56390ef556c0 con 0x56390f342aa0 2024-01-27T13:33:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.843+0000 7fcb517fa640 10 client.4677 handle_command_reply: tid=0 2024-01-27T13:33:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.843+0000 7fcb7b1e1740 1 client.4677 shutdown 2024-01-27T13:33:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 msgr2=0x56390f313cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f313cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb60005fd0 tx=0x7fcb60014040 comp rx=0 tx=0).stop 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 shutdown_connections 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x56390f330090 0x56390f2ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56390f32fcb0 0x56390f313cc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.46:6836/3746495433,v1:172.21.15.46:6837/3746495433] conn(0x56390f342aa0 0x56390f342e80 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 --2- 172.21.15.46:0/168511641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390f3171a0 0x56390f312de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb517fa640 0 client.4677 ms_handle_reset on v2:172.21.15.46:6836/3746495433 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 >> 172.21.15.46:0/168511641 conn(0x56390f2ee750 msgr2=0x56390f32adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 shutdown_connections 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 1 -- 172.21.15.46:0/168511641 wait complete. 2024-01-27T13:33:07.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb7b1e1740 20 client.4677 trim_cache size 0 max 16384 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "cd306d9e-23fd-46fc-bd31-5e5759cfb03c", 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4282, 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-01-27T13:33:07.838 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 53.866020374999998, 2024-01-27T13:33:07.839 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 10, 2024-01-27T13:33:07.839 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 27, 2024-01-27T13:33:07.839 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 25, 2024-01-27T13:33:07.839 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 61.620082682000003 2024-01-27T13:33:07.839 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fcb5406ae90 msgr2=0x7fcb5406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb78543640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fcb5406ae90 0x7fcb5406d350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb68018040 tx=0x7fcb68013000 comp rx=0 tx=0).stop 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb700c92e0 msgr2=0x7fcb701eeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.844+0000 7fcb78543640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb700c92e0 0x7fcb701eeff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb700c96c0 tx=0x7fcb6000c800 comp rx=0 tx=0).stop 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 shutdown_connections 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fcb5406ae90 0x7fcb5406d350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb700cf550 0x7fcb701592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fcb700c92e0 0x7fcb701eeff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 --2- 172.21.15.46:0/3972532087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb700c8f00 0x7fcb701e2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 >> 172.21.15.46:0/3972532087 conn(0x7fcb7008afd0 msgr2=0x7fcb701577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 shutdown_connections 2024-01-27T13:33:07.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:07.845+0000 7fcb78543640 1 -- 172.21.15.46:0/3972532087 wait complete. 2024-01-27T13:33:07.848 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-01-27T13:33:07.858 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-01-27T13:33:07.858 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-01-27T13:33:07.858 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-27T13:33:07.858 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-27T13:33:07.858 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:07.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:07.859 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T13:33:07.873 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-01-27T13:33:07.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:07.874 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-01-27T13:33:07.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:07.942 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-01-27T13:33:08.048 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-01-27T13:33:08.048 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-27T13:33:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.158+0000 7f4c9171d640 1 Processor -- start 2024-01-27T13:33:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.158+0000 7f4c9171d640 1 -- start start 2024-01-27T13:33:08.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.159+0000 7f4c9171d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4c8c151c00 0x7f4c8c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.159+0000 7f4c9171d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c0ccf60 con 0x7f4c8c0c2ca0 2024-01-27T13:33:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.159+0000 7f4c9171d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8c0ca800 con 0x7f4c8c0c28c0 2024-01-27T13:33:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.159+0000 7f4c9171d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c1576d0 con 0x7f4c8c151c00 2024-01-27T13:33:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.160+0000 7f4c8a7fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4c8c0c2ca0 0x7f4c8c1514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:58688/0 (socket says 172.21.15.46:58688) 2024-01-27T13:33:08.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.160+0000 7f4c8a7fc640 1 -- 172.21.15.46:0/948417258 learned_addr learned my addr 172.21.15.46:0/948417258 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:33:08.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.160+0000 7f4c8b7fe640 1 --2- 172.21.15.46:0/948417258 >> v2:172.21.15.78:3300/0 conn(0x7f4c8c151c00 0x7f4c8c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.162+0000 7f4c89ffb640 1 -- 172.21.15.46:0/948417258 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777662167 0 0) 0x7f4c8c0ccf60 con 0x7f4c8c0c2ca0 2024-01-27T13:33:08.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.162+0000 7f4c89ffb640 1 -- 172.21.15.46:0/948417258 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c78003520 con 0x7f4c8c0c2ca0 2024-01-27T13:33:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.163+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/948417258 >> v1:172.21.15.78:6789/0 conn(0x7f4c8c0c28c0 legacy=0x7f4c8c0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.163+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/948417258 >> v1:172.21.15.46:6789/0 conn(0x7f4c8c0c2ca0 legacy=0x7f4c8c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.163+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/948417258 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0cd200 con 0x7f4c8c151c00 2024-01-27T13:33:08.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.166+0000 7f4c8b7fe640 1 --2- 172.21.15.46:0/948417258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c151c00 0x7f4c8c157bd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009d90 tx=0x7f4c7c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e6fbd3a7a220348 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.170+0000 7f4c89ffb640 1 -- 172.21.15.46:0/948417258 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c02cd00 con 0x7f4c8c151c00 2024-01-27T13:33:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.170+0000 7f4c89ffb640 1 -- 172.21.15.46:0/948417258 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c02ce60 con 0x7f4c8c151c00 2024-01-27T13:33:08.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.170+0000 7f4c89ffb640 1 -- 172.21.15.46:0/948417258 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c034660 con 0x7f4c8c151c00 2024-01-27T13:33:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 -- 172.21.15.46:0/948417258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c151c00 msgr2=0x7f4c8c157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 --2- 172.21.15.46:0/948417258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c151c00 0x7f4c8c157bd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009d90 tx=0x7f4c7c02bf50 comp rx=0 tx=0).stop 2024-01-27T13:33:08.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 -- 172.21.15.46:0/948417258 shutdown_connections 2024-01-27T13:33:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 --2- 172.21.15.46:0/948417258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c151c00 0x7f4c8c157bd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 -- 172.21.15.46:0/948417258 >> 172.21.15.46:0/948417258 conn(0x7f4c8c06efe0 msgr2=0x7f4c8c06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 -- 172.21.15.46:0/948417258 shutdown_connections 2024-01-27T13:33:08.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.171+0000 7f4c9171d640 1 -- 172.21.15.46:0/948417258 wait complete. 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.172+0000 7f4c9171d640 1 Processor -- start 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.172+0000 7f4c9171d640 1 -- start start 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c9171d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0c28c0 0x7f4c8c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c9171d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c8c0c2ca0 0x7f4c8c1e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c9171d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 0x7f4c8c1ed5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c9171d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1de8c0 con 0x7f4c8c151c00 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c9171d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1f1360 con 0x7f4c8c0c28c0 2024-01-27T13:33:08.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c9171d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c1f07e0 con 0x7f4c8c0c2ca0 2024-01-27T13:33:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.173+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 0x7f4c8c1ed5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.174+0000 7f4c8b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 0x7f4c8c1ed5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38330/0 (socket says 172.21.15.46:38330) 2024-01-27T13:33:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.174+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/109123606 learned_addr learned my addr 172.21.15.46:0/109123606 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:33:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.174+0000 7f4c8a7fc640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c8c0c2ca0 0x7f4c8c1e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:08.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.174+0000 7f4c8affd640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0c28c0 0x7f4c8c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.177+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c8c0c2ca0 msgr2=0x7f4c8c1e4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.177+0000 7f4c8b7fe640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c8c0c2ca0 0x7f4c8c1e4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.177+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0c28c0 msgr2=0x7f4c8c0c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.177+0000 7f4c8b7fe640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0c28c0 0x7f4c8c0c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.177+0000 7f4c8b7fe640 1 -- 172.21.15.46:0/109123606 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c009a70 con 0x7f4c8c151c00 2024-01-27T13:33:08.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.179+0000 7f4c8b7fe640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 0x7f4c8c1ed5d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009d90 tx=0x7f4c7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.183+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c03e610 con 0x7f4c8c151c00 2024-01-27T13:33:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.183+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c03e770 con 0x7f4c8c151c00 2024-01-27T13:33:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.183+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c03eb00 con 0x7f4c8c151c00 2024-01-27T13:33:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.183+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c1f0ac0 con 0x7f4c8c151c00 2024-01-27T13:33:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.183+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c1f1080 con 0x7f4c8c151c00 2024-01-27T13:33:08.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.184+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c0ca350 con 0x7f4c8c151c00 2024-01-27T13:33:08.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.203+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4c7c03b050 con 0x7f4c8c151c00 2024-01-27T13:33:08.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.204+0000 7f4c837fe640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4c6c06af20 0x7f4c6c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:33:08.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.204+0000 7f4c8affd640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4c6c06af20 0x7f4c6c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:33:08.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.204+0000 7f4c8affd640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4c6c06af20 0x7f4c6c06d3e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c84001780 tx=0x7f4c84009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:33:08.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.207+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c7c07aff0 con 0x7f4c8c151c00 2024-01-27T13:33:08.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.460+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4c7c077330 con 0x7f4c8c151c00 2024-01-27T13:33:08.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.708+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c8c074410 con 0x7f4c8c151c00 2024-01-27T13:33:08.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.713+0000 7f4c837fe640 1 -- 172.21.15.46:0/109123606 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4c7c04e070 con 0x7f4c8c151c00 2024-01-27T13:33:08.706 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-01-27T13:33:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4c6c06af20 msgr2=0x7f4c6c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4c6c06af20 0x7f4c6c06d3e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c84001780 tx=0x7f4c84009040 comp rx=0 tx=0).stop 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 msgr2=0x7f4c8c1ed5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 0x7f4c8c1ed5d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009d90 tx=0x7f4c7c004a40 comp rx=0 tx=0).stop 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 shutdown_connections 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4c6c06af20 0x7f4c6c06d3e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c8c151c00 0x7f4c8c1ed5d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c8c0c2ca0 0x7f4c8c1e4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 --2- 172.21.15.46:0/109123606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c8c0c28c0 0x7f4c8c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 >> 172.21.15.46:0/109123606 conn(0x7f4c8c06efe0 msgr2=0x7f4c8c0c52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 shutdown_connections 2024-01-27T13:33:08.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:08.716+0000 7f4c9171d640 1 -- 172.21.15.46:0/109123606 wait complete. 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-27T13:33:08.719 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-27T13:33:08.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:08.720 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-01-27T13:33:08.734 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-27T13:33:08.734 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-01-27T13:33:08.735 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42310sec preferred_lft 42310sec 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link noprefixroute 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-01-27T13:33:08.736 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-27T13:33:08.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:08.736 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:33:08.737 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:33:08.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-01-27T13:33:08.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-01-27T13:33:08.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-01-27T13:33:08.737 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-27T13:33:08.737 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:33:08.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:08.843 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-27T13:33:08.868 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-01-27T13:33:08.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:08.870 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-01-27T13:33:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-01-27T13:33:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-27T13:33:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-01-27T13:33:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-01-27T13:33:08.926 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-27T13:33:08.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:08.926 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:33:08.927 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:33:08.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-01-27T13:33:08.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-01-27T13:33:08.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-01-27T13:33:08.927 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:33:09.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.023 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T13:33:09.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.038 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-01-27T13:33:09.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.093 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:33:09.093 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:33:09.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:09.093 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-27T13:33:09.093 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:33:09.175 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-27T13:33:09.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.175 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:33:09.175 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:33:09.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-27T13:33:09.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-27T13:33:09.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-27T13:33:09.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-27T13:33:09.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-27T13:33:09.176 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:33:09.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.300 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec bash -c ' 2024-01-27T13:33:09.300 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-01-27T13:33:09.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-01-27T13:33:09.300 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-01-27T13:33:09.300 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-01-27T13:33:09.342 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-01-27T13:33:09.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T13:33:09.342 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:09.397 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-27T13:33:09.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-27T13:33:09.398 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:09.451 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-27T13:33:09.452 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:09.519 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:09.575 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:09.575 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:09.576 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:09.577 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:09.578 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:09.578 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:09.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.578 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:09.632 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-01-27T13:33:09.632 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-01-27T13:33:09.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:09.701 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:09.758 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:09.759 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:09.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:09.760 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:10.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:10.943 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:10.999 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:11.000 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:11.001 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:11.001 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:11.001 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:11.001 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:11.001 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:11.004 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:11.004 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:11.004 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:11.005 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:11.005 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:11.005 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:11.005 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:11.005 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:11.005 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:11.006 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:11.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:11.007 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:12.157 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:12.184 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:12.239 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:12.240 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:12.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:12.241 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:13.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:13.422 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:13.477 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:13.478 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:13.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:13.479 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:14.632 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:14.659 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:14.715 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:14.715 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:14.715 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:14.715 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:14.715 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:14.716 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:14.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:14.718 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:15.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45865]: starting ceph client 2024-01-27T13:33:15.711 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-01-27T13:33:15.515+0000 64f7100 -1 init, newargv = 0x7a087d0 newargc=15 2024-01-27T13:33:15.870 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:15.897 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:15.953 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:15.953 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:15.953 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:15.954 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:15.955 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:15.956 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:15.956 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:15.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:15.956 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:16.324 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45865]: starting fuse 2024-01-27T13:33:17.110 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-01-27T13:33:17.138 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-01-27T13:33:17.193 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-01-27T13:33:17.194 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-0 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-1 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-2 2024-01-27T13:33:17.195 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph/osd/ceph-3 2024-01-27T13:33:17.196 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-01-27T13:33:17.196 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:17.196 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T13:33:17.196 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:17.196 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-01-27T13:33:17.249 INFO:teuthology.orchestra.run.smithi046.stdout:41 2024-01-27T13:33:17.250 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-01-27T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-01-27T13:33:17.251 DEBUG:teuthology.orchestra.run.smithi046:> 2024-01-27T13:33:17.252 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-01-27T13:33:17.252 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-01-27T13:33:17.370 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.45865.asok 2024-01-27T13:33:17.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-01-27T13:33:17.380 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45865.asok 2024-01-27T13:33:17.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:17.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45865.asok status 2024-01-27T13:33:17.622 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "99a21c3b6c137f933ecc0074a260e59bd4ba2a7f", 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.0.0-880-g99a21c3b (99a21c3b6c137f933ecc0074a260e59bd4ba2a7f) squid (dev)", 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "45865", 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4771, 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-01-27T13:33:17.623 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 4771 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 368553540 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 368553540 2024-01-27T13:33:17.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.4771 172.21.15.46:0/368553540", 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "172.21.15.46:0/368553540", 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 10, 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 27, 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-01-27T13:33:17.625 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T13:33:17.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:17.631 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-01-27T13:33:17.631 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.690 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-01-27T13:33:17.691 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T13:33:17.691 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.747 INFO:teuthology.run_tasks:Running task workunit... 2024-01-27T13:33:17.760 INFO:tasks.workunit:Pulling workunits from ref 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:33:17.760 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-27T13:33:17.760 INFO:tasks.workunit:timeout=3h 2024-01-27T13:33:17.760 INFO:tasks.workunit:cleanup=True 2024-01-27T13:33:17.760 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.775 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:fusefs_t:s0 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-01-27 13:32:14.267123658 +0000 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-01-27 13:32:27.484691826 +0000 2024-01-27T13:33:17.776 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-01-27T13:33:17.776 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-27T13:33:17.776 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-27T13:33:18.217 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 99a21c3b6c137f933ecc0074a260e59bd4ba2a7f 2024-01-27T13:33:18.232 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-27T13:33:28.518 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:33:28.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:33:58.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:33:58.611 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:34:05.661 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 96% (11663/12104) Updating files: 97% (11741/12104) Updating files: 98% (11862/12104) Updating files: 99% (11983/12104) Updating files: 100% (12104/12104) Updating files: 100% (12104/12104), done. 2024-01-27T13:34:06.431 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '99a21c3b6c137f933ecc0074a260e59bd4ba2a7f'. 2024-01-27T13:34:06.431 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.431 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-27T13:34:06.431 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-27T13:34:06.431 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-01-27T13:34:06.432 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 99a21c3b6c1 Merge pull request #55308 from ljflores/wip-dependabot 2024-01-27T13:34:06.435 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-27T13:34:06.467 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-27T13:34:06.469 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-27T13:34:06.469 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-27T13:34:07.124 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-27T13:34:07.184 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-27T13:34:07.224 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-27T13:34:07.225 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-27T13:34:07.225 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-27T13:34:07.263 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-27T13:34:07.266 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:34:07.266 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-27T13:34:07.322 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-01-27T13:34:07.323 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-01-27T13:34:07.324 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=99a21c3b6c137f933ecc0074a260e59bd4ba2a7f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-01-27T13:34:07.550 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 1 2024-01-27T13:34:07.557 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-27T13:34:07.557 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T13:34:07.557 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-27T13:34:07.564 INFO:tasks.workunit.client.0.smithi046.stdout:0 of 1 processes prepared for launch 0 sec 2024-01-27T13:34:07.664 INFO:tasks.workunit.client.0.smithi046.stdout:1 of 1 processes prepared for launch 0 sec 2024-01-27T13:34:07.665 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-01-27T13:34:08.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16 0.13 MB/sec warmup 1 sec latency 14.879 ms 2024-01-27T13:34:09.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 106 2.49 MB/sec warmup 2 sec latency 237.272 ms 2024-01-27T13:34:10.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 147 2.09 MB/sec warmup 3 sec latency 180.278 ms 2024-01-27T13:34:11.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 189 1.90 MB/sec warmup 4 sec latency 184.883 ms 2024-01-27T13:34:12.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 231 1.78 MB/sec warmup 5 sec latency 189.003 ms 2024-01-27T13:34:13.664 INFO:tasks.workunit.client.0.smithi046.stdout: 1 271 1.70 MB/sec warmup 6 sec latency 183.200 ms 2024-01-27T13:34:14.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 313 1.64 MB/sec warmup 7 sec latency 203.800 ms 2024-01-27T13:34:15.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 349 1.57 MB/sec warmup 8 sec latency 227.259 ms 2024-01-27T13:34:16.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 389 1.54 MB/sec warmup 9 sec latency 271.841 ms 2024-01-27T13:34:17.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 413 1.46 MB/sec warmup 10 sec latency 343.517 ms 2024-01-27T13:34:18.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 450 1.43 MB/sec warmup 11 sec latency 298.906 ms 2024-01-27T13:34:19.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 485 1.41 MB/sec warmup 12 sec latency 274.528 ms 2024-01-27T13:34:20.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 513 1.36 MB/sec warmup 13 sec latency 230.640 ms 2024-01-27T13:34:21.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 606 1.50 MB/sec warmup 14 sec latency 245.650 ms 2024-01-27T13:34:22.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 639 1.40 MB/sec warmup 15 sec latency 390.053 ms 2024-01-27T13:34:23.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 652 1.32 MB/sec warmup 16 sec latency 421.451 ms 2024-01-27T13:34:24.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 664 1.24 MB/sec warmup 17 sec latency 351.759 ms 2024-01-27T13:34:25.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 685 1.18 MB/sec warmup 18 sec latency 437.584 ms 2024-01-27T13:34:26.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 712 1.12 MB/sec warmup 19 sec latency 289.778 ms 2024-01-27T13:34:27.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 744 1.07 MB/sec warmup 20 sec latency 329.570 ms 2024-01-27T13:34:28.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 778 1.02 MB/sec warmup 21 sec latency 343.921 ms 2024-01-27T13:34:28.667 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:34:28.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:34:29.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 812 0.98 MB/sec warmup 22 sec latency 246.293 ms 2024-01-27T13:34:30.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 818 0.93 MB/sec warmup 23 sec latency 382.694 ms 2024-01-27T13:34:31.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 854 0.90 MB/sec warmup 24 sec latency 382.428 ms 2024-01-27T13:34:32.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 863 0.86 MB/sec warmup 25 sec latency 359.629 ms 2024-01-27T13:34:33.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 902 0.83 MB/sec warmup 26 sec latency 296.927 ms 2024-01-27T13:34:34.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 927 0.81 MB/sec warmup 27 sec latency 252.204 ms 2024-01-27T13:34:35.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 931 0.78 MB/sec warmup 28 sec latency 327.573 ms 2024-01-27T13:34:36.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 942 0.75 MB/sec warmup 29 sec latency 310.266 ms 2024-01-27T13:34:37.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 971 0.73 MB/sec warmup 30 sec latency 451.649 ms 2024-01-27T13:34:38.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1009 0.72 MB/sec warmup 31 sec latency 334.747 ms 2024-01-27T13:34:39.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1038 0.72 MB/sec warmup 32 sec latency 327.721 ms 2024-01-27T13:34:40.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1048 0.69 MB/sec warmup 33 sec latency 331.374 ms 2024-01-27T13:34:41.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1082 0.67 MB/sec warmup 34 sec latency 324.744 ms 2024-01-27T13:34:42.665 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1100 0.66 MB/sec warmup 35 sec latency 308.978 ms 2024-01-27T13:34:43.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1128 0.64 MB/sec warmup 36 sec latency 331.348 ms 2024-01-27T13:34:44.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1157 0.62 MB/sec warmup 37 sec latency 252.581 ms 2024-01-27T13:34:45.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1170 0.61 MB/sec warmup 38 sec latency 319.332 ms 2024-01-27T13:34:46.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1181 0.59 MB/sec warmup 39 sec latency 323.564 ms 2024-01-27T13:34:47.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1207 0.58 MB/sec warmup 40 sec latency 367.768 ms 2024-01-27T13:34:48.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1244 0.56 MB/sec warmup 41 sec latency 190.384 ms 2024-01-27T13:34:49.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1273 0.55 MB/sec warmup 42 sec latency 322.861 ms 2024-01-27T13:34:50.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1281 0.54 MB/sec warmup 43 sec latency 346.215 ms 2024-01-27T13:34:51.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1376 0.59 MB/sec warmup 44 sec latency 347.622 ms 2024-01-27T13:34:52.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1381 0.58 MB/sec warmup 45 sec latency 316.999 ms 2024-01-27T13:34:53.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1397 0.57 MB/sec warmup 46 sec latency 337.997 ms 2024-01-27T13:34:54.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1418 0.55 MB/sec warmup 47 sec latency 335.239 ms 2024-01-27T13:34:55.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1448 0.54 MB/sec warmup 48 sec latency 183.987 ms 2024-01-27T13:34:56.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1466 0.53 MB/sec warmup 49 sec latency 364.721 ms 2024-01-27T13:34:57.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1489 0.52 MB/sec warmup 50 sec latency 433.021 ms 2024-01-27T13:34:58.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1512 0.51 MB/sec warmup 51 sec latency 327.252 ms 2024-01-27T13:34:58.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:34:58.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:34:59.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1530 0.50 MB/sec warmup 52 sec latency 312.723 ms 2024-01-27T13:35:00.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1556 0.49 MB/sec warmup 53 sec latency 379.531 ms 2024-01-27T13:35:01.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1588 0.48 MB/sec warmup 54 sec latency 83.712 ms 2024-01-27T13:35:02.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1607 0.48 MB/sec warmup 55 sec latency 331.638 ms 2024-01-27T13:35:03.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1617 0.47 MB/sec warmup 56 sec latency 305.303 ms 2024-01-27T13:35:04.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1644 0.46 MB/sec warmup 57 sec latency 335.317 ms 2024-01-27T13:35:05.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1686 0.45 MB/sec warmup 58 sec latency 338.239 ms 2024-01-27T13:35:06.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1701 0.44 MB/sec warmup 59 sec latency 311.855 ms 2024-01-27T13:35:07.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1762 0.44 MB/sec warmup 60 sec latency 372.746 ms 2024-01-27T13:35:08.666 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1799 0.43 MB/sec warmup 61 sec latency 308.011 ms 2024-01-27T13:35:09.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1822 0.42 MB/sec warmup 62 sec latency 309.813 ms 2024-01-27T13:35:10.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1840 0.42 MB/sec warmup 63 sec latency 330.537 ms 2024-01-27T13:35:11.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1858 0.41 MB/sec warmup 64 sec latency 329.418 ms 2024-01-27T13:35:12.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1869 0.41 MB/sec warmup 65 sec latency 330.277 ms 2024-01-27T13:35:13.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1903 0.40 MB/sec warmup 66 sec latency 376.706 ms 2024-01-27T13:35:14.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1920 0.39 MB/sec warmup 67 sec latency 321.945 ms 2024-01-27T13:35:15.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1974 0.39 MB/sec warmup 68 sec latency 319.565 ms 2024-01-27T13:35:16.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 1998 0.38 MB/sec warmup 69 sec latency 318.083 ms 2024-01-27T13:35:17.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2042 0.38 MB/sec warmup 70 sec latency 347.885 ms 2024-01-27T13:35:18.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2053 0.37 MB/sec warmup 71 sec latency 324.854 ms 2024-01-27T13:35:19.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2079 0.37 MB/sec warmup 72 sec latency 343.263 ms 2024-01-27T13:35:20.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2093 0.37 MB/sec warmup 73 sec latency 342.107 ms 2024-01-27T13:35:21.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2138 0.36 MB/sec warmup 74 sec latency 346.234 ms 2024-01-27T13:35:22.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2154 0.36 MB/sec warmup 75 sec latency 379.898 ms 2024-01-27T13:35:23.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2177 0.35 MB/sec warmup 76 sec latency 336.936 ms 2024-01-27T13:35:24.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2198 0.35 MB/sec warmup 77 sec latency 332.039 ms 2024-01-27T13:35:25.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2253 0.34 MB/sec warmup 78 sec latency 317.321 ms 2024-01-27T13:35:26.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2298 0.35 MB/sec warmup 79 sec latency 307.838 ms 2024-01-27T13:35:27.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2306 0.35 MB/sec warmup 80 sec latency 352.364 ms 2024-01-27T13:35:28.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2324 0.34 MB/sec warmup 81 sec latency 307.832 ms 2024-01-27T13:35:28.917 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:35:28.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:35:29.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2340 0.34 MB/sec warmup 82 sec latency 306.911 ms 2024-01-27T13:35:30.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2361 0.34 MB/sec warmup 83 sec latency 318.101 ms 2024-01-27T13:35:31.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2366 0.33 MB/sec warmup 84 sec latency 547.830 ms 2024-01-27T13:35:32.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2376 0.33 MB/sec warmup 85 sec latency 446.544 ms 2024-01-27T13:35:33.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2396 0.33 MB/sec warmup 86 sec latency 314.014 ms 2024-01-27T13:35:34.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2417 0.32 MB/sec warmup 87 sec latency 321.948 ms 2024-01-27T13:35:35.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2432 0.32 MB/sec warmup 88 sec latency 316.625 ms 2024-01-27T13:35:36.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2449 0.32 MB/sec warmup 89 sec latency 311.632 ms 2024-01-27T13:35:37.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2470 0.32 MB/sec warmup 90 sec latency 184.566 ms 2024-01-27T13:35:38.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2492 0.32 MB/sec warmup 91 sec latency 320.022 ms 2024-01-27T13:35:39.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2506 0.31 MB/sec warmup 92 sec latency 331.414 ms 2024-01-27T13:35:40.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2559 0.31 MB/sec warmup 93 sec latency 329.338 ms 2024-01-27T13:35:41.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2577 0.31 MB/sec warmup 94 sec latency 312.149 ms 2024-01-27T13:35:42.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2591 0.31 MB/sec warmup 95 sec latency 381.569 ms 2024-01-27T13:35:43.667 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2604 0.30 MB/sec warmup 96 sec latency 300.498 ms 2024-01-27T13:35:44.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2617 0.30 MB/sec warmup 97 sec latency 313.311 ms 2024-01-27T13:35:45.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2718 0.33 MB/sec warmup 98 sec latency 326.935 ms 2024-01-27T13:35:46.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2759 0.32 MB/sec warmup 99 sec latency 334.745 ms 2024-01-27T13:35:47.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2768 0.32 MB/sec warmup 100 sec latency 592.021 ms 2024-01-27T13:35:48.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2872 0.32 MB/sec warmup 101 sec latency 302.161 ms 2024-01-27T13:35:49.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2896 0.32 MB/sec warmup 102 sec latency 310.666 ms 2024-01-27T13:35:50.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2931 0.33 MB/sec warmup 103 sec latency 172.086 ms 2024-01-27T13:35:51.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2966 0.32 MB/sec warmup 104 sec latency 296.204 ms 2024-01-27T13:35:52.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2975 0.32 MB/sec warmup 105 sec latency 338.476 ms 2024-01-27T13:35:53.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 2994 0.32 MB/sec warmup 106 sec latency 255.184 ms 2024-01-27T13:35:54.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3019 0.31 MB/sec warmup 107 sec latency 316.671 ms 2024-01-27T13:35:55.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3167 0.32 MB/sec warmup 108 sec latency 315.656 ms 2024-01-27T13:35:56.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3188 0.31 MB/sec warmup 109 sec latency 310.462 ms 2024-01-27T13:35:57.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3212 0.31 MB/sec warmup 110 sec latency 365.819 ms 2024-01-27T13:35:58.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3268 0.32 MB/sec warmup 111 sec latency 337.693 ms 2024-01-27T13:35:59.057 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:35:59.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:35:59.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3282 0.32 MB/sec warmup 112 sec latency 338.451 ms 2024-01-27T13:36:00.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3286 0.31 MB/sec warmup 113 sec latency 328.002 ms 2024-01-27T13:36:01.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3291 0.31 MB/sec warmup 114 sec latency 390.995 ms 2024-01-27T13:36:02.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3293 0.31 MB/sec warmup 115 sec latency 386.163 ms 2024-01-27T13:36:03.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3298 0.30 MB/sec warmup 116 sec latency 436.834 ms 2024-01-27T13:36:04.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3305 0.30 MB/sec warmup 117 sec latency 376.575 ms 2024-01-27T13:36:05.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3309 0.30 MB/sec warmup 118 sec latency 334.466 ms 2024-01-27T13:36:06.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3312 0.30 MB/sec warmup 119 sec latency 319.456 ms 2024-01-27T13:36:08.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3319 0.00 MB/sec execute 1 sec latency 479.355 ms 2024-01-27T13:36:09.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3323 0.00 MB/sec execute 2 sec latency 323.194 ms 2024-01-27T13:36:10.668 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3326 0.00 MB/sec execute 3 sec latency 321.639 ms 2024-01-27T13:36:11.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3331 0.00 MB/sec execute 4 sec latency 306.489 ms 2024-01-27T13:36:12.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3335 0.00 MB/sec execute 5 sec latency 315.777 ms 2024-01-27T13:36:13.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3339 0.00 MB/sec execute 6 sec latency 325.675 ms 2024-01-27T13:36:14.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3365 0.01 MB/sec execute 7 sec latency 138.742 ms 2024-01-27T13:36:15.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3391 0.02 MB/sec execute 8 sec latency 141.919 ms 2024-01-27T13:36:16.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3398 0.01 MB/sec execute 9 sec latency 334.358 ms 2024-01-27T13:36:17.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3513 0.30 MB/sec execute 10 sec latency 419.661 ms 2024-01-27T13:36:18.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3537 0.27 MB/sec execute 11 sec latency 313.001 ms 2024-01-27T13:36:19.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3558 0.25 MB/sec execute 12 sec latency 299.245 ms 2024-01-27T13:36:20.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3581 0.24 MB/sec execute 13 sec latency 303.650 ms 2024-01-27T13:36:21.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3627 0.23 MB/sec execute 14 sec latency 401.921 ms 2024-01-27T13:36:22.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3644 0.22 MB/sec execute 15 sec latency 323.445 ms 2024-01-27T13:36:23.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3672 0.21 MB/sec execute 16 sec latency 191.582 ms 2024-01-27T13:36:24.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3686 0.20 MB/sec execute 17 sec latency 344.997 ms 2024-01-27T13:36:25.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3707 0.19 MB/sec execute 18 sec latency 320.276 ms 2024-01-27T13:36:26.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3759 0.23 MB/sec execute 19 sec latency 306.245 ms 2024-01-27T13:36:27.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3776 0.22 MB/sec execute 20 sec latency 268.108 ms 2024-01-27T13:36:28.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3790 0.21 MB/sec execute 21 sec latency 209.137 ms 2024-01-27T13:36:29.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:36:29.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:36:29.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3800 0.20 MB/sec execute 22 sec latency 210.288 ms 2024-01-27T13:36:30.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3813 0.19 MB/sec execute 23 sec latency 178.007 ms 2024-01-27T13:36:31.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3828 0.18 MB/sec execute 24 sec latency 171.920 ms 2024-01-27T13:36:32.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3844 0.18 MB/sec execute 25 sec latency 214.193 ms 2024-01-27T13:36:33.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3860 0.17 MB/sec execute 26 sec latency 180.328 ms 2024-01-27T13:36:34.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3871 0.16 MB/sec execute 27 sec latency 324.664 ms 2024-01-27T13:36:35.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3884 0.16 MB/sec execute 28 sec latency 320.045 ms 2024-01-27T13:36:36.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3899 0.16 MB/sec execute 29 sec latency 337.585 ms 2024-01-27T13:36:37.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3920 0.16 MB/sec execute 30 sec latency 319.024 ms 2024-01-27T13:36:38.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3936 0.15 MB/sec execute 31 sec latency 175.861 ms 2024-01-27T13:36:39.669 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3944 0.15 MB/sec execute 32 sec latency 208.980 ms 2024-01-27T13:36:40.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3959 0.14 MB/sec execute 33 sec latency 217.977 ms 2024-01-27T13:36:41.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3975 0.14 MB/sec execute 34 sec latency 155.148 ms 2024-01-27T13:36:42.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 3991 0.13 MB/sec execute 35 sec latency 180.336 ms 2024-01-27T13:36:43.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4006 0.13 MB/sec execute 36 sec latency 163.104 ms 2024-01-27T13:36:44.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4022 0.13 MB/sec execute 37 sec latency 176.067 ms 2024-01-27T13:36:45.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4032 0.12 MB/sec execute 38 sec latency 325.596 ms 2024-01-27T13:36:46.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4042 0.12 MB/sec execute 39 sec latency 335.946 ms 2024-01-27T13:36:47.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4060 0.12 MB/sec execute 40 sec latency 317.826 ms 2024-01-27T13:36:48.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4079 0.12 MB/sec execute 41 sec latency 296.905 ms 2024-01-27T13:36:49.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4096 0.11 MB/sec execute 42 sec latency 297.065 ms 2024-01-27T13:36:50.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4117 0.11 MB/sec execute 43 sec latency 254.988 ms 2024-01-27T13:36:51.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4147 0.11 MB/sec execute 44 sec latency 230.535 ms 2024-01-27T13:36:52.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4159 0.10 MB/sec execute 45 sec latency 444.072 ms 2024-01-27T13:36:53.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4173 0.10 MB/sec execute 46 sec latency 233.211 ms 2024-01-27T13:36:54.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4181 0.10 MB/sec execute 47 sec latency 375.726 ms 2024-01-27T13:36:55.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4217 0.10 MB/sec execute 48 sec latency 354.219 ms 2024-01-27T13:36:56.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4226 0.10 MB/sec execute 49 sec latency 344.367 ms 2024-01-27T13:36:57.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4254 0.10 MB/sec execute 50 sec latency 294.203 ms 2024-01-27T13:36:58.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4289 0.10 MB/sec execute 51 sec latency 323.352 ms 2024-01-27T13:36:59.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:36:59.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:36:59.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4317 0.10 MB/sec execute 52 sec latency 336.819 ms 2024-01-27T13:37:00.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4351 0.10 MB/sec execute 53 sec latency 321.404 ms 2024-01-27T13:37:01.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4384 0.10 MB/sec execute 54 sec latency 309.232 ms 2024-01-27T13:37:02.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4393 0.10 MB/sec execute 55 sec latency 513.824 ms 2024-01-27T13:37:03.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4426 0.10 MB/sec execute 56 sec latency 374.885 ms 2024-01-27T13:37:04.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4444 0.09 MB/sec execute 57 sec latency 333.124 ms 2024-01-27T13:37:05.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4473 0.09 MB/sec execute 58 sec latency 296.396 ms 2024-01-27T13:37:06.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4498 0.09 MB/sec execute 59 sec latency 313.122 ms 2024-01-27T13:37:07.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4505 0.09 MB/sec execute 60 sec latency 366.783 ms 2024-01-27T13:37:08.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4536 0.09 MB/sec execute 61 sec latency 315.219 ms 2024-01-27T13:37:09.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4563 0.09 MB/sec execute 62 sec latency 281.741 ms 2024-01-27T13:37:10.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4600 0.11 MB/sec execute 63 sec latency 345.389 ms 2024-01-27T13:37:11.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4615 0.10 MB/sec execute 64 sec latency 328.474 ms 2024-01-27T13:37:12.670 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4628 0.10 MB/sec execute 65 sec latency 438.237 ms 2024-01-27T13:37:13.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4656 0.10 MB/sec execute 66 sec latency 319.249 ms 2024-01-27T13:37:14.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4681 0.10 MB/sec execute 67 sec latency 320.447 ms 2024-01-27T13:37:15.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4715 0.10 MB/sec execute 68 sec latency 293.698 ms 2024-01-27T13:37:16.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4734 0.10 MB/sec execute 69 sec latency 303.848 ms 2024-01-27T13:37:17.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4743 0.10 MB/sec execute 70 sec latency 321.036 ms 2024-01-27T13:37:18.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4770 0.10 MB/sec execute 71 sec latency 298.900 ms 2024-01-27T13:37:19.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4802 0.09 MB/sec execute 72 sec latency 422.371 ms 2024-01-27T13:37:20.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4825 0.09 MB/sec execute 73 sec latency 317.035 ms 2024-01-27T13:37:21.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4846 0.09 MB/sec execute 74 sec latency 360.225 ms 2024-01-27T13:37:22.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4884 0.11 MB/sec execute 75 sec latency 553.905 ms 2024-01-27T13:37:23.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4947 0.13 MB/sec execute 76 sec latency 325.983 ms 2024-01-27T13:37:24.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4963 0.13 MB/sec execute 77 sec latency 313.317 ms 2024-01-27T13:37:25.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 4984 0.13 MB/sec execute 78 sec latency 358.615 ms 2024-01-27T13:37:26.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5014 0.12 MB/sec execute 79 sec latency 254.743 ms 2024-01-27T13:37:27.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5032 0.12 MB/sec execute 80 sec latency 355.625 ms 2024-01-27T13:37:28.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5056 0.12 MB/sec execute 81 sec latency 319.019 ms 2024-01-27T13:37:29.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:37:29.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:37:29.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5082 0.12 MB/sec execute 82 sec latency 311.988 ms 2024-01-27T13:37:30.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5098 0.12 MB/sec execute 83 sec latency 304.360 ms 2024-01-27T13:37:31.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5129 0.12 MB/sec execute 84 sec latency 300.490 ms 2024-01-27T13:37:32.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5154 0.12 MB/sec execute 85 sec latency 114.072 ms 2024-01-27T13:37:33.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5175 0.12 MB/sec execute 86 sec latency 316.928 ms 2024-01-27T13:37:34.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5190 0.11 MB/sec execute 87 sec latency 328.152 ms 2024-01-27T13:37:35.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5209 0.11 MB/sec execute 88 sec latency 307.367 ms 2024-01-27T13:37:36.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5251 0.11 MB/sec execute 89 sec latency 341.473 ms 2024-01-27T13:37:37.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5272 0.11 MB/sec execute 90 sec latency 302.992 ms 2024-01-27T13:37:38.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5335 0.11 MB/sec execute 91 sec latency 311.540 ms 2024-01-27T13:37:39.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5369 0.11 MB/sec execute 92 sec latency 312.053 ms 2024-01-27T13:37:40.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5387 0.11 MB/sec execute 93 sec latency 341.965 ms 2024-01-27T13:37:41.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5406 0.11 MB/sec execute 94 sec latency 312.959 ms 2024-01-27T13:37:42.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5424 0.11 MB/sec execute 95 sec latency 473.646 ms 2024-01-27T13:37:43.671 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5434 0.11 MB/sec execute 96 sec latency 311.586 ms 2024-01-27T13:37:44.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5468 0.10 MB/sec execute 97 sec latency 384.029 ms 2024-01-27T13:37:45.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5485 0.10 MB/sec execute 98 sec latency 313.228 ms 2024-01-27T13:37:46.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5540 0.10 MB/sec execute 99 sec latency 311.265 ms 2024-01-27T13:37:47.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5573 0.10 MB/sec execute 100 sec latency 311.483 ms 2024-01-27T13:37:48.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5605 0.10 MB/sec execute 101 sec latency 332.932 ms 2024-01-27T13:37:49.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5620 0.10 MB/sec execute 102 sec latency 304.222 ms 2024-01-27T13:37:50.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5641 0.10 MB/sec execute 103 sec latency 320.817 ms 2024-01-27T13:37:51.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5658 0.10 MB/sec execute 104 sec latency 335.905 ms 2024-01-27T13:37:52.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5701 0.10 MB/sec execute 105 sec latency 446.911 ms 2024-01-27T13:37:53.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5730 0.10 MB/sec execute 106 sec latency 365.659 ms 2024-01-27T13:37:54.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5741 0.10 MB/sec execute 107 sec latency 359.425 ms 2024-01-27T13:37:55.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5762 0.10 MB/sec execute 108 sec latency 328.364 ms 2024-01-27T13:37:56.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5820 0.10 MB/sec execute 109 sec latency 330.361 ms 2024-01-27T13:37:57.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5863 0.10 MB/sec execute 110 sec latency 305.248 ms 2024-01-27T13:37:58.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5867 0.10 MB/sec execute 111 sec latency 458.641 ms 2024-01-27T13:37:59.381 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:37:59.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:37:59.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5893 0.10 MB/sec execute 112 sec latency 329.010 ms 2024-01-27T13:38:00.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5900 0.10 MB/sec execute 113 sec latency 317.950 ms 2024-01-27T13:38:01.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5922 0.10 MB/sec execute 114 sec latency 310.890 ms 2024-01-27T13:38:02.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5926 0.10 MB/sec execute 115 sec latency 784.203 ms 2024-01-27T13:38:03.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5948 0.10 MB/sec execute 116 sec latency 333.956 ms 2024-01-27T13:38:04.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5960 0.10 MB/sec execute 117 sec latency 319.898 ms 2024-01-27T13:38:05.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5988 0.10 MB/sec execute 118 sec latency 299.423 ms 2024-01-27T13:38:06.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 5994 0.10 MB/sec execute 119 sec latency 329.812 ms 2024-01-27T13:38:07.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6013 0.10 MB/sec execute 120 sec latency 166.712 ms 2024-01-27T13:38:08.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6047 0.10 MB/sec execute 121 sec latency 296.042 ms 2024-01-27T13:38:09.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6055 0.10 MB/sec execute 122 sec latency 351.700 ms 2024-01-27T13:38:10.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6107 0.10 MB/sec execute 123 sec latency 314.020 ms 2024-01-27T13:38:11.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6118 0.10 MB/sec execute 124 sec latency 328.941 ms 2024-01-27T13:38:12.672 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6138 0.10 MB/sec execute 125 sec latency 333.470 ms 2024-01-27T13:38:13.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6154 0.10 MB/sec execute 126 sec latency 346.469 ms 2024-01-27T13:38:14.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6166 0.10 MB/sec execute 127 sec latency 307.146 ms 2024-01-27T13:38:15.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6176 0.10 MB/sec execute 128 sec latency 328.690 ms 2024-01-27T13:38:16.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6277 0.12 MB/sec execute 129 sec latency 316.002 ms 2024-01-27T13:38:17.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6316 0.12 MB/sec execute 130 sec latency 327.197 ms 2024-01-27T13:38:18.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6336 0.12 MB/sec execute 131 sec latency 353.004 ms 2024-01-27T13:38:19.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6434 0.12 MB/sec execute 132 sec latency 310.670 ms 2024-01-27T13:38:20.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6458 0.12 MB/sec execute 133 sec latency 176.897 ms 2024-01-27T13:38:21.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6493 0.13 MB/sec execute 134 sec latency 205.097 ms 2024-01-27T13:38:22.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6528 0.13 MB/sec execute 135 sec latency 419.990 ms 2024-01-27T13:38:23.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6540 0.13 MB/sec execute 136 sec latency 425.500 ms 2024-01-27T13:38:24.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6565 0.13 MB/sec execute 137 sec latency 312.373 ms 2024-01-27T13:38:25.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6586 0.13 MB/sec execute 138 sec latency 260.702 ms 2024-01-27T13:38:26.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6726 0.13 MB/sec execute 139 sec latency 417.151 ms 2024-01-27T13:38:27.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6745 0.13 MB/sec execute 140 sec latency 339.834 ms 2024-01-27T13:38:28.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6820 0.14 MB/sec execute 141 sec latency 245.420 ms 2024-01-27T13:38:29.586 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:38:29.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:38:29.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6834 0.13 MB/sec execute 142 sec latency 316.640 ms 2024-01-27T13:38:30.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6837 0.13 MB/sec execute 143 sec latency 329.415 ms 2024-01-27T13:38:31.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6841 0.13 MB/sec execute 144 sec latency 387.922 ms 2024-01-27T13:38:32.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6845 0.13 MB/sec execute 145 sec latency 486.161 ms 2024-01-27T13:38:33.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6848 0.13 MB/sec execute 146 sec latency 375.607 ms 2024-01-27T13:38:34.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6854 0.13 MB/sec execute 147 sec latency 430.860 ms 2024-01-27T13:38:35.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6862 0.13 MB/sec execute 148 sec latency 381.370 ms 2024-01-27T13:38:36.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6865 0.13 MB/sec execute 149 sec latency 331.278 ms 2024-01-27T13:38:37.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6868 0.13 MB/sec execute 150 sec latency 319.953 ms 2024-01-27T13:38:38.673 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6872 0.13 MB/sec execute 151 sec latency 322.771 ms 2024-01-27T13:38:39.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6877 0.13 MB/sec execute 152 sec latency 327.680 ms 2024-01-27T13:38:40.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6880 0.12 MB/sec execute 153 sec latency 320.860 ms 2024-01-27T13:38:41.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6885 0.12 MB/sec execute 154 sec latency 305.404 ms 2024-01-27T13:38:42.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6888 0.12 MB/sec execute 155 sec latency 459.818 ms 2024-01-27T13:38:43.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6891 0.12 MB/sec execute 156 sec latency 309.157 ms 2024-01-27T13:38:44.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6907 0.12 MB/sec execute 157 sec latency 304.826 ms 2024-01-27T13:38:45.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6932 0.12 MB/sec execute 158 sec latency 141.865 ms 2024-01-27T13:38:46.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 6948 0.12 MB/sec execute 159 sec latency 334.490 ms 2024-01-27T13:38:47.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7047 0.14 MB/sec execute 160 sec latency 334.964 ms 2024-01-27T13:38:48.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7082 0.14 MB/sec execute 161 sec latency 219.876 ms 2024-01-27T13:38:49.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7108 0.14 MB/sec execute 162 sec latency 299.917 ms 2024-01-27T13:38:50.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7123 0.14 MB/sec execute 163 sec latency 336.462 ms 2024-01-27T13:38:51.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7164 0.14 MB/sec execute 164 sec latency 306.075 ms 2024-01-27T13:38:52.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7188 0.14 MB/sec execute 165 sec latency 207.484 ms 2024-01-27T13:38:53.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7212 0.14 MB/sec execute 166 sec latency 328.818 ms 2024-01-27T13:38:54.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7229 0.13 MB/sec execute 167 sec latency 391.135 ms 2024-01-27T13:38:55.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7247 0.13 MB/sec execute 168 sec latency 323.649 ms 2024-01-27T13:38:56.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7283 0.14 MB/sec execute 169 sec latency 151.414 ms 2024-01-27T13:38:57.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7315 0.14 MB/sec execute 170 sec latency 417.113 ms 2024-01-27T13:38:58.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7332 0.14 MB/sec execute 171 sec latency 179.212 ms 2024-01-27T13:38:59.638 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:38:59.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:38:59.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7340 0.14 MB/sec execute 172 sec latency 218.842 ms 2024-01-27T13:39:00.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7352 0.14 MB/sec execute 173 sec latency 219.947 ms 2024-01-27T13:39:01.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7368 0.14 MB/sec execute 174 sec latency 179.687 ms 2024-01-27T13:39:02.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7382 0.13 MB/sec execute 175 sec latency 218.722 ms 2024-01-27T13:39:03.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7396 0.13 MB/sec execute 176 sec latency 184.794 ms 2024-01-27T13:39:04.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7413 0.13 MB/sec execute 177 sec latency 196.809 ms 2024-01-27T13:39:05.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7423 0.13 MB/sec execute 178 sec latency 318.830 ms 2024-01-27T13:39:06.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7442 0.13 MB/sec execute 179 sec latency 340.008 ms 2024-01-27T13:39:07.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7458 0.13 MB/sec execute 180 sec latency 310.177 ms 2024-01-27T13:39:08.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7475 0.13 MB/sec execute 181 sec latency 297.592 ms 2024-01-27T13:39:09.674 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7485 0.13 MB/sec execute 182 sec latency 210.184 ms 2024-01-27T13:39:10.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7497 0.13 MB/sec execute 183 sec latency 206.285 ms 2024-01-27T13:39:11.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7513 0.13 MB/sec execute 184 sec latency 150.748 ms 2024-01-27T13:39:12.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7527 0.13 MB/sec execute 185 sec latency 197.707 ms 2024-01-27T13:39:13.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7543 0.13 MB/sec execute 186 sec latency 174.300 ms 2024-01-27T13:39:14.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7559 0.13 MB/sec execute 187 sec latency 171.683 ms 2024-01-27T13:39:15.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7571 0.13 MB/sec execute 188 sec latency 362.487 ms 2024-01-27T13:39:16.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7579 0.13 MB/sec execute 189 sec latency 376.839 ms 2024-01-27T13:39:17.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7599 0.13 MB/sec execute 190 sec latency 316.095 ms 2024-01-27T13:39:18.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7612 0.12 MB/sec execute 191 sec latency 311.434 ms 2024-01-27T13:39:19.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7632 0.12 MB/sec execute 192 sec latency 323.308 ms 2024-01-27T13:39:20.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7654 0.12 MB/sec execute 193 sec latency 203.528 ms 2024-01-27T13:39:21.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7678 0.12 MB/sec execute 194 sec latency 238.838 ms 2024-01-27T13:39:22.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7695 0.12 MB/sec execute 195 sec latency 446.798 ms 2024-01-27T13:39:23.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7714 0.12 MB/sec execute 196 sec latency 231.583 ms 2024-01-27T13:39:24.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7721 0.12 MB/sec execute 197 sec latency 319.653 ms 2024-01-27T13:39:25.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7758 0.12 MB/sec execute 198 sec latency 330.693 ms 2024-01-27T13:39:26.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7767 0.12 MB/sec execute 199 sec latency 340.418 ms 2024-01-27T13:39:27.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7794 0.12 MB/sec execute 200 sec latency 364.570 ms 2024-01-27T13:39:28.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7823 0.12 MB/sec execute 201 sec latency 318.149 ms 2024-01-27T13:39:29.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7857 0.12 MB/sec execute 202 sec latency 251.243 ms 2024-01-27T13:39:29.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:39:29.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:39:30.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7886 0.12 MB/sec execute 203 sec latency 366.909 ms 2024-01-27T13:39:31.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7924 0.12 MB/sec execute 204 sec latency 263.854 ms 2024-01-27T13:39:32.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7928 0.12 MB/sec execute 205 sec latency 520.864 ms 2024-01-27T13:39:33.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7965 0.12 MB/sec execute 206 sec latency 327.691 ms 2024-01-27T13:39:34.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7974 0.12 MB/sec execute 207 sec latency 325.719 ms 2024-01-27T13:39:35.675 INFO:tasks.workunit.client.0.smithi046.stdout: 1 7992 0.12 MB/sec execute 208 sec latency 339.352 ms 2024-01-27T13:39:36.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8028 0.12 MB/sec execute 209 sec latency 306.310 ms 2024-01-27T13:39:37.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8041 0.12 MB/sec execute 210 sec latency 344.371 ms 2024-01-27T13:39:38.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8048 0.12 MB/sec execute 211 sec latency 307.224 ms 2024-01-27T13:39:39.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8081 0.12 MB/sec execute 212 sec latency 318.138 ms 2024-01-27T13:39:40.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8109 0.12 MB/sec execute 213 sec latency 326.834 ms 2024-01-27T13:39:41.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8147 0.12 MB/sec execute 214 sec latency 293.160 ms 2024-01-27T13:39:42.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8157 0.12 MB/sec execute 215 sec latency 449.468 ms 2024-01-27T13:39:43.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8174 0.12 MB/sec execute 216 sec latency 368.322 ms 2024-01-27T13:39:44.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8209 0.12 MB/sec execute 217 sec latency 386.810 ms 2024-01-27T13:39:45.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8227 0.12 MB/sec execute 218 sec latency 309.479 ms 2024-01-27T13:39:46.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8266 0.12 MB/sec execute 219 sec latency 203.337 ms 2024-01-27T13:39:47.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8277 0.12 MB/sec execute 220 sec latency 319.813 ms 2024-01-27T13:39:48.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8286 0.12 MB/sec execute 221 sec latency 309.932 ms 2024-01-27T13:39:49.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8319 0.12 MB/sec execute 222 sec latency 301.802 ms 2024-01-27T13:39:50.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8352 0.12 MB/sec execute 223 sec latency 201.762 ms 2024-01-27T13:39:51.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8385 0.12 MB/sec execute 224 sec latency 350.281 ms 2024-01-27T13:39:52.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8388 0.12 MB/sec execute 225 sec latency 563.005 ms 2024-01-27T13:39:53.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8485 0.13 MB/sec execute 226 sec latency 592.186 ms 2024-01-27T13:39:54.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8491 0.13 MB/sec execute 227 sec latency 313.997 ms 2024-01-27T13:39:55.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8506 0.13 MB/sec execute 228 sec latency 317.587 ms 2024-01-27T13:39:56.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8528 0.13 MB/sec execute 229 sec latency 322.863 ms 2024-01-27T13:39:57.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8557 0.13 MB/sec execute 230 sec latency 311.368 ms 2024-01-27T13:39:58.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8588 0.13 MB/sec execute 231 sec latency 358.035 ms 2024-01-27T13:39:59.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8599 0.12 MB/sec execute 232 sec latency 330.849 ms 2024-01-27T13:39:59.854 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:39:59.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:40:00.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8632 0.12 MB/sec execute 233 sec latency 338.883 ms 2024-01-27T13:40:01.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8647 0.12 MB/sec execute 234 sec latency 317.336 ms 2024-01-27T13:40:02.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8670 0.12 MB/sec execute 235 sec latency 466.972 ms 2024-01-27T13:40:03.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8697 0.12 MB/sec execute 236 sec latency 91.493 ms 2024-01-27T13:40:04.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8718 0.12 MB/sec execute 237 sec latency 321.107 ms 2024-01-27T13:40:05.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8740 0.12 MB/sec execute 238 sec latency 315.792 ms 2024-01-27T13:40:06.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8754 0.12 MB/sec execute 239 sec latency 342.025 ms 2024-01-27T13:40:07.676 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8794 0.12 MB/sec execute 240 sec latency 269.697 ms 2024-01-27T13:40:08.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8809 0.12 MB/sec execute 241 sec latency 441.056 ms 2024-01-27T13:40:09.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8877 0.12 MB/sec execute 242 sec latency 318.292 ms 2024-01-27T13:40:10.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8910 0.12 MB/sec execute 243 sec latency 311.737 ms 2024-01-27T13:40:11.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8930 0.12 MB/sec execute 244 sec latency 321.506 ms 2024-01-27T13:40:12.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8944 0.12 MB/sec execute 245 sec latency 440.110 ms 2024-01-27T13:40:13.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8967 0.12 MB/sec execute 246 sec latency 312.483 ms 2024-01-27T13:40:14.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 8978 0.12 MB/sec execute 247 sec latency 318.315 ms 2024-01-27T13:40:15.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9011 0.12 MB/sec execute 248 sec latency 333.827 ms 2024-01-27T13:40:16.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9025 0.12 MB/sec execute 249 sec latency 318.131 ms 2024-01-27T13:40:17.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9082 0.12 MB/sec execute 250 sec latency 298.529 ms 2024-01-27T13:40:18.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9106 0.12 MB/sec execute 251 sec latency 316.851 ms 2024-01-27T13:40:19.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9148 0.12 MB/sec execute 252 sec latency 315.435 ms 2024-01-27T13:40:20.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9159 0.12 MB/sec execute 253 sec latency 306.314 ms 2024-01-27T13:40:21.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9185 0.12 MB/sec execute 254 sec latency 323.634 ms 2024-01-27T13:40:22.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9195 0.12 MB/sec execute 255 sec latency 522.225 ms 2024-01-27T13:40:23.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9234 0.12 MB/sec execute 256 sec latency 331.008 ms 2024-01-27T13:40:24.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9252 0.12 MB/sec execute 257 sec latency 304.263 ms 2024-01-27T13:40:25.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9281 0.11 MB/sec execute 258 sec latency 354.532 ms 2024-01-27T13:40:26.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9303 0.11 MB/sec execute 259 sec latency 353.910 ms 2024-01-27T13:40:27.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9352 0.11 MB/sec execute 260 sec latency 333.984 ms 2024-01-27T13:40:28.410 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:08:56.061 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.513 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:08:56.103 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.517 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:08:56.107 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.521 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:08:56.173 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.568 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:08:56.159 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.571 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:08:56.162 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9398 0.12 MB/sec execute 261 sec latency 335.454 ms 2024-01-27T13:40:28.929 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:08:56.520 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.937 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:08:56.528 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:28.984 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:08:56.635 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:40:29.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9410 0.12 MB/sec execute 262 sec latency 325.875 ms 2024-01-27T13:40:29.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:40:29.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:40:30.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9425 0.12 MB/sec execute 263 sec latency 505.350 ms 2024-01-27T13:40:31.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9439 0.12 MB/sec execute 264 sec latency 334.062 ms 2024-01-27T13:40:32.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9457 0.12 MB/sec execute 265 sec latency 452.713 ms 2024-01-27T13:40:33.677 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9468 0.12 MB/sec execute 266 sec latency 325.471 ms 2024-01-27T13:40:34.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9472 0.12 MB/sec execute 267 sec latency 588.839 ms 2024-01-27T13:40:35.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9495 0.12 MB/sec execute 268 sec latency 330.210 ms 2024-01-27T13:40:36.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9511 0.11 MB/sec execute 269 sec latency 317.409 ms 2024-01-27T13:40:37.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9533 0.11 MB/sec execute 270 sec latency 315.893 ms 2024-01-27T13:40:38.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9543 0.11 MB/sec execute 271 sec latency 313.639 ms 2024-01-27T13:40:39.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9570 0.12 MB/sec execute 272 sec latency 169.654 ms 2024-01-27T13:40:40.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9593 0.12 MB/sec execute 273 sec latency 350.279 ms 2024-01-27T13:40:41.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9605 0.12 MB/sec execute 274 sec latency 319.339 ms 2024-01-27T13:40:42.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9653 0.12 MB/sec execute 275 sec latency 394.295 ms 2024-01-27T13:40:43.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9668 0.12 MB/sec execute 276 sec latency 324.730 ms 2024-01-27T13:40:44.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9683 0.11 MB/sec execute 277 sec latency 334.657 ms 2024-01-27T13:40:45.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9702 0.11 MB/sec execute 278 sec latency 389.782 ms 2024-01-27T13:40:46.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9717 0.11 MB/sec execute 279 sec latency 326.874 ms 2024-01-27T13:40:47.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9723 0.11 MB/sec execute 280 sec latency 334.075 ms 2024-01-27T13:40:48.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9846 0.12 MB/sec execute 281 sec latency 323.009 ms 2024-01-27T13:40:49.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9861 0.12 MB/sec execute 282 sec latency 345.672 ms 2024-01-27T13:40:50.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9880 0.12 MB/sec execute 283 sec latency 250.862 ms 2024-01-27T13:40:51.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 9979 0.12 MB/sec execute 284 sec latency 310.630 ms 2024-01-27T13:40:52.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10016 0.13 MB/sec execute 285 sec latency 246.038 ms 2024-01-27T13:40:53.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10037 0.13 MB/sec execute 286 sec latency 220.158 ms 2024-01-27T13:40:54.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10073 0.13 MB/sec execute 287 sec latency 321.496 ms 2024-01-27T13:40:55.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10088 0.13 MB/sec execute 288 sec latency 442.975 ms 2024-01-27T13:40:56.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10111 0.13 MB/sec execute 289 sec latency 319.063 ms 2024-01-27T13:40:57.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10130 0.13 MB/sec execute 290 sec latency 233.157 ms 2024-01-27T13:40:58.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10275 0.13 MB/sec execute 291 sec latency 406.496 ms 2024-01-27T13:40:59.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10303 0.13 MB/sec execute 292 sec latency 335.158 ms 2024-01-27T13:41:00.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:41:00.052 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:41:00.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10365 0.13 MB/sec execute 293 sec latency 252.441 ms 2024-01-27T13:41:01.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10379 0.13 MB/sec execute 294 sec latency 324.173 ms 2024-01-27T13:41:02.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10382 0.13 MB/sec execute 295 sec latency 447.113 ms 2024-01-27T13:41:03.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10386 0.13 MB/sec execute 296 sec latency 355.823 ms 2024-01-27T13:41:04.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10391 0.13 MB/sec execute 297 sec latency 326.156 ms 2024-01-27T13:41:05.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10394 0.13 MB/sec execute 298 sec latency 386.913 ms 2024-01-27T13:41:06.678 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10398 0.13 MB/sec execute 299 sec latency 442.117 ms 2024-01-27T13:41:07.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10406 0.13 MB/sec execute 300 sec latency 313.539 ms 2024-01-27T13:41:08.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10409 0.13 MB/sec execute 301 sec latency 328.119 ms 2024-01-27T13:41:09.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10412 0.13 MB/sec execute 302 sec latency 317.948 ms 2024-01-27T13:41:09.973 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:37.624 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:09.984 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:37.636 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:09.987 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:09:37.578 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:09.990 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:09:37.581 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:09.992 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:09:37.583 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:09.996 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:09:37.587 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:10.038 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:09:37.689 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:10.048 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:09:37.639 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:10.052 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:09:37.643 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:41:10.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10416 0.13 MB/sec execute 303 sec latency 325.340 ms 2024-01-27T13:41:11.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10419 0.13 MB/sec execute 304 sec latency 307.802 ms 2024-01-27T13:41:12.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10423 0.13 MB/sec execute 305 sec latency 437.534 ms 2024-01-27T13:41:13.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10426 0.12 MB/sec execute 306 sec latency 308.299 ms 2024-01-27T13:41:14.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10431 0.12 MB/sec execute 307 sec latency 315.111 ms 2024-01-27T13:41:15.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10435 0.12 MB/sec execute 308 sec latency 327.868 ms 2024-01-27T13:41:16.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10451 0.12 MB/sec execute 309 sec latency 314.590 ms 2024-01-27T13:41:17.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10472 0.12 MB/sec execute 310 sec latency 141.180 ms 2024-01-27T13:41:18.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10492 0.12 MB/sec execute 311 sec latency 336.549 ms 2024-01-27T13:41:19.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10591 0.13 MB/sec execute 312 sec latency 336.993 ms 2024-01-27T13:41:20.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10627 0.13 MB/sec execute 313 sec latency 146.348 ms 2024-01-27T13:41:21.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10647 0.13 MB/sec execute 314 sec latency 321.133 ms 2024-01-27T13:41:22.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10659 0.13 MB/sec execute 315 sec latency 362.981 ms 2024-01-27T13:41:23.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10680 0.13 MB/sec execute 316 sec latency 364.038 ms 2024-01-27T13:41:24.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10730 0.13 MB/sec execute 317 sec latency 311.018 ms 2024-01-27T13:41:25.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10755 0.13 MB/sec execute 318 sec latency 321.943 ms 2024-01-27T13:41:26.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10767 0.13 MB/sec execute 319 sec latency 416.338 ms 2024-01-27T13:41:27.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10786 0.13 MB/sec execute 320 sec latency 312.478 ms 2024-01-27T13:41:28.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10813 0.13 MB/sec execute 321 sec latency 145.257 ms 2024-01-27T13:41:29.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10858 0.13 MB/sec execute 322 sec latency 323.165 ms 2024-01-27T13:41:30.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:41:30.124 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:41:30.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10871 0.13 MB/sec execute 323 sec latency 328.599 ms 2024-01-27T13:41:31.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10881 0.13 MB/sec execute 324 sec latency 234.023 ms 2024-01-27T13:41:32.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10891 0.13 MB/sec execute 325 sec latency 231.654 ms 2024-01-27T13:41:33.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10909 0.13 MB/sec execute 326 sec latency 222.446 ms 2024-01-27T13:41:34.679 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10925 0.13 MB/sec execute 327 sec latency 152.869 ms 2024-01-27T13:41:35.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10938 0.13 MB/sec execute 328 sec latency 176.104 ms 2024-01-27T13:41:36.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10954 0.13 MB/sec execute 329 sec latency 160.233 ms 2024-01-27T13:41:37.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10966 0.13 MB/sec execute 330 sec latency 322.568 ms 2024-01-27T13:41:38.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10986 0.13 MB/sec execute 331 sec latency 359.813 ms 2024-01-27T13:41:39.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 10993 0.13 MB/sec execute 332 sec latency 334.432 ms 2024-01-27T13:41:40.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11016 0.13 MB/sec execute 333 sec latency 317.354 ms 2024-01-27T13:41:41.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11028 0.13 MB/sec execute 334 sec latency 180.768 ms 2024-01-27T13:41:42.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11037 0.13 MB/sec execute 335 sec latency 300.270 ms 2024-01-27T13:41:43.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11051 0.13 MB/sec execute 336 sec latency 203.188 ms 2024-01-27T13:41:44.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11066 0.13 MB/sec execute 337 sec latency 179.762 ms 2024-01-27T13:41:45.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11082 0.13 MB/sec execute 338 sec latency 164.595 ms 2024-01-27T13:41:46.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11099 0.13 MB/sec execute 339 sec latency 170.377 ms 2024-01-27T13:41:47.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11115 0.13 MB/sec execute 340 sec latency 150.870 ms 2024-01-27T13:41:48.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11122 0.13 MB/sec execute 341 sec latency 337.084 ms 2024-01-27T13:41:49.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11137 0.13 MB/sec execute 342 sec latency 341.968 ms 2024-01-27T13:41:50.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11152 0.13 MB/sec execute 343 sec latency 318.093 ms 2024-01-27T13:41:51.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11172 0.12 MB/sec execute 344 sec latency 306.724 ms 2024-01-27T13:41:52.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11194 0.12 MB/sec execute 345 sec latency 314.838 ms 2024-01-27T13:41:53.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11213 0.12 MB/sec execute 346 sec latency 217.193 ms 2024-01-27T13:41:54.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11241 0.12 MB/sec execute 347 sec latency 96.223 ms 2024-01-27T13:41:55.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11252 0.12 MB/sec execute 348 sec latency 410.926 ms 2024-01-27T13:41:56.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11265 0.12 MB/sec execute 349 sec latency 342.403 ms 2024-01-27T13:41:57.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11277 0.12 MB/sec execute 350 sec latency 380.974 ms 2024-01-27T13:41:58.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11314 0.12 MB/sec execute 351 sec latency 309.639 ms 2024-01-27T13:41:59.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11341 0.12 MB/sec execute 352 sec latency 374.244 ms 2024-01-27T13:42:00.278 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:42:00.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:42:00.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11368 0.12 MB/sec execute 353 sec latency 308.573 ms 2024-01-27T13:42:01.680 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11404 0.12 MB/sec execute 354 sec latency 254.532 ms 2024-01-27T13:42:02.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11422 0.12 MB/sec execute 355 sec latency 552.093 ms 2024-01-27T13:42:03.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11456 0.12 MB/sec execute 356 sec latency 244.881 ms 2024-01-27T13:42:04.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11474 0.12 MB/sec execute 357 sec latency 342.523 ms 2024-01-27T13:42:05.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11510 0.12 MB/sec execute 358 sec latency 315.987 ms 2024-01-27T13:42:06.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11521 0.12 MB/sec execute 359 sec latency 378.042 ms 2024-01-27T13:42:07.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11539 0.12 MB/sec execute 360 sec latency 353.504 ms 2024-01-27T13:42:08.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11567 0.12 MB/sec execute 361 sec latency 297.884 ms 2024-01-27T13:42:09.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11588 0.12 MB/sec execute 362 sec latency 321.867 ms 2024-01-27T13:42:10.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11595 0.12 MB/sec execute 363 sec latency 312.136 ms 2024-01-27T13:42:11.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11627 0.12 MB/sec execute 364 sec latency 338.553 ms 2024-01-27T13:42:12.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11652 0.12 MB/sec execute 365 sec latency 325.402 ms 2024-01-27T13:42:13.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11688 0.12 MB/sec execute 366 sec latency 540.403 ms 2024-01-27T13:42:14.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11704 0.12 MB/sec execute 367 sec latency 312.058 ms 2024-01-27T13:42:15.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11717 0.12 MB/sec execute 368 sec latency 324.808 ms 2024-01-27T13:42:16.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11752 0.12 MB/sec execute 369 sec latency 299.024 ms 2024-01-27T13:42:17.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11770 0.12 MB/sec execute 370 sec latency 317.077 ms 2024-01-27T13:42:18.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11810 0.12 MB/sec execute 371 sec latency 304.714 ms 2024-01-27T13:42:19.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11825 0.12 MB/sec execute 372 sec latency 317.733 ms 2024-01-27T13:42:20.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11833 0.12 MB/sec execute 373 sec latency 325.650 ms 2024-01-27T13:42:21.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11860 0.12 MB/sec execute 374 sec latency 269.499 ms 2024-01-27T13:42:22.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11889 0.12 MB/sec execute 375 sec latency 305.708 ms 2024-01-27T13:42:23.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11911 0.12 MB/sec execute 376 sec latency 335.047 ms 2024-01-27T13:42:24.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 11936 0.12 MB/sec execute 377 sec latency 346.555 ms 2024-01-27T13:42:25.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12032 0.13 MB/sec execute 378 sec latency 334.035 ms 2024-01-27T13:42:26.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12037 0.13 MB/sec execute 379 sec latency 319.039 ms 2024-01-27T13:42:27.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12053 0.13 MB/sec execute 380 sec latency 306.200 ms 2024-01-27T13:42:28.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12074 0.13 MB/sec execute 381 sec latency 362.747 ms 2024-01-27T13:42:29.681 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12104 0.13 MB/sec execute 382 sec latency 207.515 ms 2024-01-27T13:42:30.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:42:30.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:42:30.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12122 0.13 MB/sec execute 383 sec latency 311.882 ms 2024-01-27T13:42:31.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12146 0.13 MB/sec execute 384 sec latency 340.303 ms 2024-01-27T13:42:32.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12168 0.12 MB/sec execute 385 sec latency 365.557 ms 2024-01-27T13:42:33.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12186 0.12 MB/sec execute 386 sec latency 312.480 ms 2024-01-27T13:42:34.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12213 0.12 MB/sec execute 387 sec latency 374.454 ms 2024-01-27T13:42:35.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12244 0.12 MB/sec execute 388 sec latency 97.046 ms 2024-01-27T13:42:36.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12264 0.12 MB/sec execute 389 sec latency 343.558 ms 2024-01-27T13:42:37.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12272 0.12 MB/sec execute 390 sec latency 336.750 ms 2024-01-27T13:42:38.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12299 0.12 MB/sec execute 391 sec latency 339.349 ms 2024-01-27T13:42:39.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12341 0.12 MB/sec execute 392 sec latency 352.539 ms 2024-01-27T13:42:40.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12356 0.12 MB/sec execute 393 sec latency 317.607 ms 2024-01-27T13:42:41.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12420 0.12 MB/sec execute 394 sec latency 322.103 ms 2024-01-27T13:42:42.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12455 0.12 MB/sec execute 395 sec latency 311.739 ms 2024-01-27T13:42:43.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12478 0.12 MB/sec execute 396 sec latency 309.905 ms 2024-01-27T13:42:44.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12493 0.12 MB/sec execute 397 sec latency 318.513 ms 2024-01-27T13:42:45.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12514 0.12 MB/sec execute 398 sec latency 307.653 ms 2024-01-27T13:42:46.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12527 0.12 MB/sec execute 399 sec latency 318.063 ms 2024-01-27T13:42:47.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12561 0.12 MB/sec execute 400 sec latency 347.259 ms 2024-01-27T13:42:48.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12578 0.12 MB/sec execute 401 sec latency 341.403 ms 2024-01-27T13:42:49.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12631 0.12 MB/sec execute 402 sec latency 317.184 ms 2024-01-27T13:42:50.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12655 0.12 MB/sec execute 403 sec latency 321.495 ms 2024-01-27T13:42:51.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12691 0.12 MB/sec execute 404 sec latency 309.917 ms 2024-01-27T13:42:52.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12708 0.12 MB/sec execute 405 sec latency 405.929 ms 2024-01-27T13:42:53.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12729 0.12 MB/sec execute 406 sec latency 320.700 ms 2024-01-27T13:42:54.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12748 0.12 MB/sec execute 407 sec latency 316.059 ms 2024-01-27T13:42:55.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12791 0.12 MB/sec execute 408 sec latency 379.948 ms 2024-01-27T13:42:56.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12801 0.12 MB/sec execute 409 sec latency 312.215 ms 2024-01-27T13:42:57.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12830 0.12 MB/sec execute 410 sec latency 360.501 ms 2024-01-27T13:42:58.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12852 0.12 MB/sec execute 411 sec latency 347.079 ms 2024-01-27T13:42:59.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12905 0.12 MB/sec execute 412 sec latency 312.969 ms 2024-01-27T13:43:00.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:43:00.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:43:00.682 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12953 0.12 MB/sec execute 413 sec latency 305.041 ms 2024-01-27T13:43:01.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12961 0.12 MB/sec execute 414 sec latency 322.357 ms 2024-01-27T13:43:02.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12978 0.12 MB/sec execute 415 sec latency 444.782 ms 2024-01-27T13:43:03.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 12994 0.12 MB/sec execute 416 sec latency 476.494 ms 2024-01-27T13:43:04.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13015 0.12 MB/sec execute 417 sec latency 329.047 ms 2024-01-27T13:43:05.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13020 0.12 MB/sec execute 418 sec latency 365.201 ms 2024-01-27T13:43:06.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13037 0.12 MB/sec execute 419 sec latency 542.399 ms 2024-01-27T13:43:07.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13053 0.12 MB/sec execute 420 sec latency 322.867 ms 2024-01-27T13:43:08.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13077 0.12 MB/sec execute 421 sec latency 312.549 ms 2024-01-27T13:43:09.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13086 0.12 MB/sec execute 422 sec latency 315.621 ms 2024-01-27T13:43:10.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13105 0.12 MB/sec execute 423 sec latency 318.344 ms 2024-01-27T13:43:11.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13131 0.12 MB/sec execute 424 sec latency 338.601 ms 2024-01-27T13:43:12.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13148 0.12 MB/sec execute 425 sec latency 374.361 ms 2024-01-27T13:43:13.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13201 0.12 MB/sec execute 426 sec latency 374.096 ms 2024-01-27T13:43:14.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13212 0.12 MB/sec execute 427 sec latency 343.733 ms 2024-01-27T13:43:15.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13232 0.12 MB/sec execute 428 sec latency 350.843 ms 2024-01-27T13:43:16.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13248 0.12 MB/sec execute 429 sec latency 361.359 ms 2024-01-27T13:43:17.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13259 0.12 MB/sec execute 430 sec latency 308.496 ms 2024-01-27T13:43:18.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13270 0.12 MB/sec execute 431 sec latency 316.770 ms 2024-01-27T13:43:19.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13370 0.12 MB/sec execute 432 sec latency 312.837 ms 2024-01-27T13:43:20.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13410 0.12 MB/sec execute 433 sec latency 327.262 ms 2024-01-27T13:43:21.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13426 0.12 MB/sec execute 434 sec latency 330.660 ms 2024-01-27T13:43:22.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13522 0.12 MB/sec execute 435 sec latency 325.365 ms 2024-01-27T13:43:23.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13551 0.13 MB/sec execute 436 sec latency 429.718 ms 2024-01-27T13:43:24.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13581 0.13 MB/sec execute 437 sec latency 202.813 ms 2024-01-27T13:43:25.683 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13617 0.13 MB/sec execute 438 sec latency 315.317 ms 2024-01-27T13:43:26.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13628 0.13 MB/sec execute 439 sec latency 348.364 ms 2024-01-27T13:43:27.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13646 0.13 MB/sec execute 440 sec latency 316.473 ms 2024-01-27T13:43:28.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13673 0.13 MB/sec execute 441 sec latency 211.984 ms 2024-01-27T13:43:29.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13817 0.13 MB/sec execute 442 sec latency 340.831 ms 2024-01-27T13:43:30.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13838 0.13 MB/sec execute 443 sec latency 342.942 ms 2024-01-27T13:43:30.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:43:30.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:43:31.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13887 0.13 MB/sec execute 444 sec latency 333.439 ms 2024-01-27T13:43:32.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13922 0.13 MB/sec execute 445 sec latency 399.217 ms 2024-01-27T13:43:33.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13931 0.13 MB/sec execute 446 sec latency 305.949 ms 2024-01-27T13:43:34.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13935 0.13 MB/sec execute 447 sec latency 332.351 ms 2024-01-27T13:43:35.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13940 0.13 MB/sec execute 448 sec latency 367.629 ms 2024-01-27T13:43:36.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13943 0.13 MB/sec execute 449 sec latency 415.413 ms 2024-01-27T13:43:37.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13947 0.13 MB/sec execute 450 sec latency 398.353 ms 2024-01-27T13:43:38.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13955 0.13 MB/sec execute 451 sec latency 401.953 ms 2024-01-27T13:43:39.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13958 0.13 MB/sec execute 452 sec latency 337.624 ms 2024-01-27T13:43:40.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13961 0.13 MB/sec execute 453 sec latency 336.071 ms 2024-01-27T13:43:41.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13965 0.13 MB/sec execute 454 sec latency 325.097 ms 2024-01-27T13:43:42.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13968 0.13 MB/sec execute 455 sec latency 349.593 ms 2024-01-27T13:43:43.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13972 0.13 MB/sec execute 456 sec latency 449.253 ms 2024-01-27T13:43:44.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13976 0.13 MB/sec execute 457 sec latency 324.280 ms 2024-01-27T13:43:45.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13981 0.13 MB/sec execute 458 sec latency 320.082 ms 2024-01-27T13:43:46.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13984 0.12 MB/sec execute 459 sec latency 309.043 ms 2024-01-27T13:43:47.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 13991 0.12 MB/sec execute 460 sec latency 314.777 ms 2024-01-27T13:43:48.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14015 0.12 MB/sec execute 461 sec latency 151.726 ms 2024-01-27T13:43:49.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14040 0.12 MB/sec execute 462 sec latency 203.364 ms 2024-01-27T13:43:50.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14047 0.12 MB/sec execute 463 sec latency 339.106 ms 2024-01-27T13:43:51.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14164 0.13 MB/sec execute 464 sec latency 341.401 ms 2024-01-27T13:43:52.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14189 0.13 MB/sec execute 465 sec latency 307.634 ms 2024-01-27T13:43:53.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14206 0.13 MB/sec execute 466 sec latency 311.487 ms 2024-01-27T13:43:54.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14223 0.13 MB/sec execute 467 sec latency 310.171 ms 2024-01-27T13:43:55.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14269 0.13 MB/sec execute 468 sec latency 334.017 ms 2024-01-27T13:43:56.684 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14285 0.13 MB/sec execute 469 sec latency 313.674 ms 2024-01-27T13:43:57.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14313 0.13 MB/sec execute 470 sec latency 199.495 ms 2024-01-27T13:43:58.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14328 0.13 MB/sec execute 471 sec latency 325.106 ms 2024-01-27T13:43:59.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14349 0.13 MB/sec execute 472 sec latency 144.985 ms 2024-01-27T13:44:00.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14397 0.13 MB/sec execute 473 sec latency 282.397 ms 2024-01-27T13:44:00.877 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:44:00.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:44:01.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14418 0.13 MB/sec execute 474 sec latency 300.583 ms 2024-01-27T13:44:02.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14429 0.13 MB/sec execute 475 sec latency 253.436 ms 2024-01-27T13:44:03.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14439 0.13 MB/sec execute 476 sec latency 210.147 ms 2024-01-27T13:44:04.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14454 0.13 MB/sec execute 477 sec latency 203.695 ms 2024-01-27T13:44:05.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14469 0.13 MB/sec execute 478 sec latency 204.730 ms 2024-01-27T13:44:06.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14485 0.13 MB/sec execute 479 sec latency 175.228 ms 2024-01-27T13:44:07.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14499 0.13 MB/sec execute 480 sec latency 174.300 ms 2024-01-27T13:44:08.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14510 0.13 MB/sec execute 481 sec latency 317.223 ms 2024-01-27T13:44:09.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14524 0.13 MB/sec execute 482 sec latency 315.937 ms 2024-01-27T13:44:10.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14540 0.13 MB/sec execute 483 sec latency 317.812 ms 2024-01-27T13:44:11.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14562 0.13 MB/sec execute 484 sec latency 304.154 ms 2024-01-27T13:44:12.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14576 0.13 MB/sec execute 485 sec latency 207.967 ms 2024-01-27T13:44:13.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14587 0.13 MB/sec execute 486 sec latency 231.252 ms 2024-01-27T13:44:14.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14602 0.13 MB/sec execute 487 sec latency 202.631 ms 2024-01-27T13:44:15.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14617 0.13 MB/sec execute 488 sec latency 190.486 ms 2024-01-27T13:44:16.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14633 0.13 MB/sec execute 489 sec latency 171.161 ms 2024-01-27T13:44:17.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14647 0.13 MB/sec execute 490 sec latency 215.359 ms 2024-01-27T13:44:18.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14662 0.13 MB/sec execute 491 sec latency 162.822 ms 2024-01-27T13:44:19.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14671 0.13 MB/sec execute 492 sec latency 331.257 ms 2024-01-27T13:44:20.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14683 0.13 MB/sec execute 493 sec latency 343.877 ms 2024-01-27T13:44:21.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14699 0.13 MB/sec execute 494 sec latency 305.542 ms 2024-01-27T13:44:22.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14721 0.13 MB/sec execute 495 sec latency 320.070 ms 2024-01-27T13:44:23.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14741 0.13 MB/sec execute 496 sec latency 312.036 ms 2024-01-27T13:44:24.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14756 0.12 MB/sec execute 497 sec latency 298.523 ms 2024-01-27T13:44:25.685 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14787 0.12 MB/sec execute 498 sec latency 97.851 ms 2024-01-27T13:44:26.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14798 0.12 MB/sec execute 499 sec latency 425.465 ms 2024-01-27T13:44:27.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14812 0.12 MB/sec execute 500 sec latency 306.498 ms 2024-01-27T13:44:28.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14822 0.12 MB/sec execute 501 sec latency 571.194 ms 2024-01-27T13:44:29.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14856 0.12 MB/sec execute 502 sec latency 386.022 ms 2024-01-27T13:44:30.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14872 0.12 MB/sec execute 503 sec latency 373.003 ms 2024-01-27T13:44:31.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:44:31.020 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:44:31.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14904 0.12 MB/sec execute 504 sec latency 300.043 ms 2024-01-27T13:44:32.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14938 0.12 MB/sec execute 505 sec latency 249.468 ms 2024-01-27T13:44:33.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 14972 0.12 MB/sec execute 506 sec latency 304.214 ms 2024-01-27T13:44:34.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15005 0.12 MB/sec execute 507 sec latency 230.097 ms 2024-01-27T13:44:35.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15022 0.12 MB/sec execute 508 sec latency 323.606 ms 2024-01-27T13:44:36.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15059 0.12 MB/sec execute 509 sec latency 310.281 ms 2024-01-27T13:44:37.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15068 0.12 MB/sec execute 510 sec latency 386.965 ms 2024-01-27T13:44:38.037 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:13:05.688 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.090 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:13:05.681 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.091 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:13:05.682 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.105 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:13:05.757 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.164 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:13:05.756 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.186 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:13:05.838 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.235 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:13:05.824 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.235 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:13:05.826 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.327 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:13:05.918 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:44:38.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15086 0.12 MB/sec execute 511 sec latency 547.468 ms 2024-01-27T13:44:39.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15119 0.12 MB/sec execute 512 sec latency 299.761 ms 2024-01-27T13:44:40.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15135 0.12 MB/sec execute 513 sec latency 327.804 ms 2024-01-27T13:44:41.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15142 0.12 MB/sec execute 514 sec latency 302.116 ms 2024-01-27T13:44:42.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15174 0.12 MB/sec execute 515 sec latency 318.482 ms 2024-01-27T13:44:43.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15203 0.12 MB/sec execute 516 sec latency 318.926 ms 2024-01-27T13:44:44.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15238 0.12 MB/sec execute 517 sec latency 329.547 ms 2024-01-27T13:44:45.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15252 0.12 MB/sec execute 518 sec latency 319.268 ms 2024-01-27T13:44:46.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15268 0.12 MB/sec execute 519 sec latency 327.580 ms 2024-01-27T13:44:47.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15303 0.12 MB/sec execute 520 sec latency 304.943 ms 2024-01-27T13:44:48.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15321 0.12 MB/sec execute 521 sec latency 327.485 ms 2024-01-27T13:44:49.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15359 0.12 MB/sec execute 522 sec latency 203.093 ms 2024-01-27T13:44:50.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15371 0.12 MB/sec execute 523 sec latency 324.229 ms 2024-01-27T13:44:51.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15380 0.12 MB/sec execute 524 sec latency 317.192 ms 2024-01-27T13:44:52.686 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15406 0.12 MB/sec execute 525 sec latency 316.767 ms 2024-01-27T13:44:53.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15447 0.12 MB/sec execute 526 sec latency 381.925 ms 2024-01-27T13:44:54.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15466 0.12 MB/sec execute 527 sec latency 395.573 ms 2024-01-27T13:44:55.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15483 0.12 MB/sec execute 528 sec latency 348.417 ms 2024-01-27T13:44:56.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15578 0.13 MB/sec execute 529 sec latency 349.508 ms 2024-01-27T13:44:57.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15583 0.13 MB/sec execute 530 sec latency 319.903 ms 2024-01-27T13:44:58.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15599 0.13 MB/sec execute 531 sec latency 379.381 ms 2024-01-27T13:44:59.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15620 0.13 MB/sec execute 532 sec latency 328.600 ms 2024-01-27T13:45:00.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15649 0.13 MB/sec execute 533 sec latency 194.413 ms 2024-01-27T13:45:01.072 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:45:01.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:45:01.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15668 0.13 MB/sec execute 534 sec latency 292.789 ms 2024-01-27T13:45:02.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15691 0.13 MB/sec execute 535 sec latency 344.622 ms 2024-01-27T13:45:03.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15714 0.13 MB/sec execute 536 sec latency 339.485 ms 2024-01-27T13:45:04.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15732 0.13 MB/sec execute 537 sec latency 301.902 ms 2024-01-27T13:45:05.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15761 0.12 MB/sec execute 538 sec latency 295.582 ms 2024-01-27T13:45:06.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15789 0.12 MB/sec execute 539 sec latency 106.567 ms 2024-01-27T13:45:07.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15807 0.12 MB/sec execute 540 sec latency 377.576 ms 2024-01-27T13:45:08.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15818 0.12 MB/sec execute 541 sec latency 384.099 ms 2024-01-27T13:45:09.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15845 0.12 MB/sec execute 542 sec latency 316.652 ms 2024-01-27T13:45:10.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15887 0.12 MB/sec execute 543 sec latency 343.065 ms 2024-01-27T13:45:11.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15902 0.12 MB/sec execute 544 sec latency 282.803 ms 2024-01-27T13:45:12.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 15970 0.12 MB/sec execute 545 sec latency 318.072 ms 2024-01-27T13:45:13.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16004 0.12 MB/sec execute 546 sec latency 315.875 ms 2024-01-27T13:45:14.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16023 0.12 MB/sec execute 547 sec latency 343.555 ms 2024-01-27T13:45:15.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16041 0.12 MB/sec execute 548 sec latency 303.219 ms 2024-01-27T13:45:16.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16060 0.12 MB/sec execute 549 sec latency 348.607 ms 2024-01-27T13:45:17.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16070 0.12 MB/sec execute 550 sec latency 325.647 ms 2024-01-27T13:45:18.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16104 0.12 MB/sec execute 551 sec latency 412.062 ms 2024-01-27T13:45:19.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16121 0.12 MB/sec execute 552 sec latency 322.498 ms 2024-01-27T13:45:20.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16176 0.12 MB/sec execute 553 sec latency 307.301 ms 2024-01-27T13:45:21.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16207 0.12 MB/sec execute 554 sec latency 313.407 ms 2024-01-27T13:45:22.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16241 0.12 MB/sec execute 555 sec latency 317.731 ms 2024-01-27T13:45:23.687 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16255 0.12 MB/sec execute 556 sec latency 327.654 ms 2024-01-27T13:45:24.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16277 0.12 MB/sec execute 557 sec latency 343.328 ms 2024-01-27T13:45:25.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16291 0.12 MB/sec execute 558 sec latency 329.955 ms 2024-01-27T13:45:26.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16336 0.12 MB/sec execute 559 sec latency 372.292 ms 2024-01-27T13:45:27.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16364 0.12 MB/sec execute 560 sec latency 368.807 ms 2024-01-27T13:45:28.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16378 0.12 MB/sec execute 561 sec latency 334.638 ms 2024-01-27T13:45:29.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16399 0.12 MB/sec execute 562 sec latency 319.681 ms 2024-01-27T13:45:30.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16459 0.12 MB/sec execute 563 sec latency 327.726 ms 2024-01-27T13:45:31.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:45:31.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:45:31.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16497 0.12 MB/sec execute 564 sec latency 293.421 ms 2024-01-27T13:45:32.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16503 0.12 MB/sec execute 565 sec latency 366.902 ms 2024-01-27T13:45:33.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16530 0.12 MB/sec execute 566 sec latency 308.054 ms 2024-01-27T13:45:34.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16544 0.12 MB/sec execute 567 sec latency 321.899 ms 2024-01-27T13:45:35.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16558 0.12 MB/sec execute 568 sec latency 341.665 ms 2024-01-27T13:45:36.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16563 0.12 MB/sec execute 569 sec latency 567.754 ms 2024-01-27T13:45:37.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16584 0.12 MB/sec execute 570 sec latency 312.362 ms 2024-01-27T13:45:38.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16596 0.12 MB/sec execute 571 sec latency 309.536 ms 2024-01-27T13:45:39.691 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16624 0.12 MB/sec execute 572 sec latency 310.547 ms 2024-01-27T13:45:40.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16630 0.12 MB/sec execute 573 sec latency 327.745 ms 2024-01-27T13:45:41.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16650 0.12 MB/sec execute 574 sec latency 188.920 ms 2024-01-27T13:45:42.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16685 0.12 MB/sec execute 575 sec latency 324.922 ms 2024-01-27T13:45:43.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16693 0.12 MB/sec execute 576 sec latency 346.346 ms 2024-01-27T13:45:44.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16744 0.12 MB/sec execute 577 sec latency 341.851 ms 2024-01-27T13:45:45.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16755 0.12 MB/sec execute 578 sec latency 324.643 ms 2024-01-27T13:45:46.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16775 0.12 MB/sec execute 579 sec latency 355.772 ms 2024-01-27T13:45:47.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16791 0.12 MB/sec execute 580 sec latency 363.254 ms 2024-01-27T13:45:48.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16804 0.12 MB/sec execute 581 sec latency 335.772 ms 2024-01-27T13:45:49.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16813 0.12 MB/sec execute 582 sec latency 319.018 ms 2024-01-27T13:45:50.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16912 0.13 MB/sec execute 583 sec latency 322.792 ms 2024-01-27T13:45:51.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16953 0.13 MB/sec execute 584 sec latency 334.442 ms 2024-01-27T13:45:52.688 INFO:tasks.workunit.client.0.smithi046.stdout: 1 16972 0.12 MB/sec execute 585 sec latency 365.437 ms 2024-01-27T13:45:53.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17068 0.13 MB/sec execute 586 sec latency 306.619 ms 2024-01-27T13:45:54.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17095 0.13 MB/sec execute 587 sec latency 159.375 ms 2024-01-27T13:45:55.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17130 0.13 MB/sec execute 588 sec latency 212.114 ms 2024-01-27T13:45:56.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17165 0.13 MB/sec execute 589 sec latency 332.242 ms 2024-01-27T13:45:57.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17181 0.13 MB/sec execute 590 sec latency 359.067 ms 2024-01-27T13:45:58.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17199 0.13 MB/sec execute 591 sec latency 310.201 ms 2024-01-27T13:45:59.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17217 0.13 MB/sec execute 592 sec latency 244.784 ms 2024-01-27T13:46:00.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17363 0.13 MB/sec execute 593 sec latency 347.572 ms 2024-01-27T13:46:01.298 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:46:01.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:46:01.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17382 0.13 MB/sec execute 594 sec latency 322.338 ms 2024-01-27T13:46:02.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17458 0.13 MB/sec execute 595 sec latency 210.714 ms 2024-01-27T13:46:03.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17472 0.13 MB/sec execute 596 sec latency 322.339 ms 2024-01-27T13:46:04.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17475 0.13 MB/sec execute 597 sec latency 327.695 ms 2024-01-27T13:46:05.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17479 0.13 MB/sec execute 598 sec latency 317.773 ms 2024-01-27T13:46:06.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 17484 0.13 MB/sec execute 599 sec latency 367.738 ms 2024-01-27T13:46:07.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 600 sec 2024-01-27T13:46:08.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 601 sec 2024-01-27T13:46:09.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 602 sec 2024-01-27T13:46:10.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 603 sec 2024-01-27T13:46:11.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 604 sec 2024-01-27T13:46:12.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 605 sec 2024-01-27T13:46:13.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 606 sec 2024-01-27T13:46:14.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 607 sec 2024-01-27T13:46:15.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 608 sec 2024-01-27T13:46:16.689 INFO:tasks.workunit.client.0.smithi046.stdout: 1 cleanup 609 sec 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 610 sec 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 2453 66.481 328.591 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Close 1801 1.249 28.095 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 104 198.431 441.048 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 496 75.618 217.548 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 2233 36.327 283.054 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 388 0.986 1.820 2024-01-27T13:46:17.423 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 405 9.883 214.821 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 200 12.349 16.062 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: Find 848 325.038 784.197 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 1210 4.140 114.668 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 3848 0.026 2.501 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: LockX 8 16.110 20.412 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: UnlockX 8 16.829 27.396 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 170 47.406 122.808 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 0.127646 MB/sec 1 clients 1 procs max_latency=784.203 ms 2024-01-27T13:46:17.424 INFO:tasks.workunit.client.0.smithi046.stderr:+ dbench 10 2024-01-27T13:46:17.425 INFO:tasks.workunit.client.0.smithi046.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-01-27T13:46:17.425 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T13:46:17.425 INFO:tasks.workunit.client.0.smithi046.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-01-27T13:46:17.425 INFO:tasks.workunit.client.0.smithi046.stdout:8 of 10 processes prepared for launch 0 sec 2024-01-27T13:46:17.524 INFO:tasks.workunit.client.0.smithi046.stdout:10 of 10 processes prepared for launch 0 sec 2024-01-27T13:46:17.524 INFO:tasks.workunit.client.0.smithi046.stdout:releasing clients 2024-01-27T13:46:18.524 INFO:tasks.workunit.client.0.smithi046.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.914 ms 2024-01-27T13:46:19.524 INFO:tasks.workunit.client.0.smithi046.stdout: 0 5 0.00 MB/sec warmup 2 sec latency 1999.951 ms 2024-01-27T13:46:20.524 INFO:tasks.workunit.client.0.smithi046.stdout: 0 8 0.00 MB/sec warmup 3 sec latency 549.286 ms 2024-01-27T13:46:21.524 INFO:tasks.workunit.client.0.smithi046.stdout: 5 19 1.16 MB/sec warmup 4 sec latency 699.579 ms 2024-01-27T13:46:22.524 INFO:tasks.workunit.client.0.smithi046.stdout: 10 34 2.39 MB/sec warmup 5 sec latency 792.876 ms 2024-01-27T13:46:23.524 INFO:tasks.workunit.client.0.smithi046.stdout: 10 49 3.32 MB/sec warmup 6 sec latency 808.975 ms 2024-01-27T13:46:24.524 INFO:tasks.workunit.client.0.smithi046.stdout: 10 63 3.88 MB/sec warmup 7 sec latency 900.940 ms 2024-01-27T13:46:25.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 78 4.44 MB/sec warmup 8 sec latency 854.351 ms 2024-01-27T13:46:26.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 92 4.70 MB/sec warmup 9 sec latency 894.490 ms 2024-01-27T13:46:27.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 106 5.00 MB/sec warmup 10 sec latency 985.788 ms 2024-01-27T13:46:28.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 113 4.81 MB/sec warmup 11 sec latency 1323.108 ms 2024-01-27T13:46:29.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 119 4.54 MB/sec warmup 12 sec latency 1378.307 ms 2024-01-27T13:46:30.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 125 4.35 MB/sec warmup 13 sec latency 1359.873 ms 2024-01-27T13:46:31.383 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:46:31.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:46:31.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 130 4.13 MB/sec warmup 14 sec latency 1471.603 ms 2024-01-27T13:46:32.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 136 3.98 MB/sec warmup 15 sec latency 1669.141 ms 2024-01-27T13:46:33.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 141 3.83 MB/sec warmup 16 sec latency 1408.782 ms 2024-01-27T13:46:34.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 146 3.67 MB/sec warmup 17 sec latency 1331.467 ms 2024-01-27T13:46:35.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 152 3.58 MB/sec warmup 18 sec latency 1108.951 ms 2024-01-27T13:46:36.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 159 3.50 MB/sec warmup 19 sec latency 1439.124 ms 2024-01-27T13:46:37.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 161 3.35 MB/sec warmup 20 sec latency 1350.796 ms 2024-01-27T13:46:38.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 165 3.24 MB/sec warmup 21 sec latency 1549.327 ms 2024-01-27T13:46:39.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 169 3.16 MB/sec warmup 22 sec latency 1803.220 ms 2024-01-27T13:46:40.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 174 3.09 MB/sec warmup 23 sec latency 2453.827 ms 2024-01-27T13:46:41.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 179 3.03 MB/sec warmup 24 sec latency 1516.899 ms 2024-01-27T13:46:42.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 187 3.01 MB/sec warmup 25 sec latency 1711.981 ms 2024-01-27T13:46:43.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 189 2.92 MB/sec warmup 26 sec latency 1531.047 ms 2024-01-27T13:46:44.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 194 2.87 MB/sec warmup 27 sec latency 1766.728 ms 2024-01-27T13:46:45.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 201 2.84 MB/sec warmup 28 sec latency 1809.024 ms 2024-01-27T13:46:46.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 204 2.77 MB/sec warmup 29 sec latency 1948.188 ms 2024-01-27T13:46:47.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 208 2.72 MB/sec warmup 30 sec latency 1468.712 ms 2024-01-27T13:46:48.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 215 2.70 MB/sec warmup 31 sec latency 1559.241 ms 2024-01-27T13:46:49.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 217 2.64 MB/sec warmup 32 sec latency 1828.206 ms 2024-01-27T13:46:50.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 224 2.63 MB/sec warmup 33 sec latency 1915.330 ms 2024-01-27T13:46:51.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 231 2.62 MB/sec warmup 34 sec latency 1574.326 ms 2024-01-27T13:46:52.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 235 2.58 MB/sec warmup 35 sec latency 1745.054 ms 2024-01-27T13:46:53.525 INFO:tasks.workunit.client.0.smithi046.stdout: 10 240 2.55 MB/sec warmup 36 sec latency 1764.592 ms 2024-01-27T13:46:54.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 242 2.50 MB/sec warmup 37 sec latency 2273.208 ms 2024-01-27T13:46:55.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 250 2.50 MB/sec warmup 38 sec latency 2383.815 ms 2024-01-27T13:46:56.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 253 2.46 MB/sec warmup 39 sec latency 1656.249 ms 2024-01-27T13:46:57.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 258 2.44 MB/sec warmup 40 sec latency 2085.713 ms 2024-01-27T13:46:58.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 262 2.41 MB/sec warmup 41 sec latency 1950.869 ms 2024-01-27T13:46:59.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 266 2.39 MB/sec warmup 42 sec latency 2101.441 ms 2024-01-27T13:47:00.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 271 2.37 MB/sec warmup 43 sec latency 1921.727 ms 2024-01-27T13:47:01.498 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:47:01.500 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:47:01.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 276 2.36 MB/sec warmup 44 sec latency 1936.248 ms 2024-01-27T13:47:02.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 279 2.32 MB/sec warmup 45 sec latency 1913.373 ms 2024-01-27T13:47:03.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 286 2.32 MB/sec warmup 46 sec latency 1930.024 ms 2024-01-27T13:47:04.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 287 2.28 MB/sec warmup 47 sec latency 2017.685 ms 2024-01-27T13:47:05.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 293 2.27 MB/sec warmup 48 sec latency 2467.735 ms 2024-01-27T13:47:06.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 297 2.24 MB/sec warmup 49 sec latency 1784.209 ms 2024-01-27T13:47:07.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 303 2.23 MB/sec warmup 50 sec latency 2130.561 ms 2024-01-27T13:47:08.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 309 2.23 MB/sec warmup 51 sec latency 1402.997 ms 2024-01-27T13:47:09.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 312 2.20 MB/sec warmup 52 sec latency 1804.360 ms 2024-01-27T13:47:10.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 317 2.19 MB/sec warmup 53 sec latency 2206.755 ms 2024-01-27T13:47:11.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 323 2.18 MB/sec warmup 54 sec latency 1447.574 ms 2024-01-27T13:47:12.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 327 2.16 MB/sec warmup 55 sec latency 1563.723 ms 2024-01-27T13:47:13.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 331 2.14 MB/sec warmup 56 sec latency 1599.752 ms 2024-01-27T13:47:14.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 333 2.12 MB/sec warmup 57 sec latency 1892.933 ms 2024-01-27T13:47:15.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 340 2.12 MB/sec warmup 58 sec latency 2163.700 ms 2024-01-27T13:47:16.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 344 2.11 MB/sec warmup 59 sec latency 1544.071 ms 2024-01-27T13:47:17.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 350 2.10 MB/sec warmup 60 sec latency 1786.705 ms 2024-01-27T13:47:18.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 353 2.08 MB/sec warmup 61 sec latency 1618.580 ms 2024-01-27T13:47:19.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 358 2.07 MB/sec warmup 62 sec latency 2115.000 ms 2024-01-27T13:47:20.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 364 2.07 MB/sec warmup 63 sec latency 2268.888 ms 2024-01-27T13:47:21.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 369 2.06 MB/sec warmup 64 sec latency 1533.615 ms 2024-01-27T13:47:22.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 374 2.05 MB/sec warmup 65 sec latency 1561.700 ms 2024-01-27T13:47:23.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 379 2.05 MB/sec warmup 66 sec latency 1946.047 ms 2024-01-27T13:47:24.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 385 2.04 MB/sec warmup 67 sec latency 2130.451 ms 2024-01-27T13:47:25.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 387 2.03 MB/sec warmup 68 sec latency 2428.395 ms 2024-01-27T13:47:26.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 393 2.02 MB/sec warmup 69 sec latency 2361.383 ms 2024-01-27T13:47:27.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 395 2.00 MB/sec warmup 70 sec latency 2071.987 ms 2024-01-27T13:47:28.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 401 2.00 MB/sec warmup 71 sec latency 2180.091 ms 2024-01-27T13:47:29.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 403 1.99 MB/sec warmup 72 sec latency 2585.964 ms 2024-01-27T13:47:30.526 INFO:tasks.workunit.client.0.smithi046.stdout: 10 411 1.99 MB/sec warmup 73 sec latency 2218.409 ms 2024-01-27T13:47:31.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 414 1.98 MB/sec warmup 74 sec latency 1443.364 ms 2024-01-27T13:47:31.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:47:31.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:47:32.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 419 1.97 MB/sec warmup 75 sec latency 2124.725 ms 2024-01-27T13:47:33.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 423 1.97 MB/sec warmup 76 sec latency 2032.589 ms 2024-01-27T13:47:34.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 425 1.95 MB/sec warmup 77 sec latency 2108.625 ms 2024-01-27T13:47:35.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 431 1.95 MB/sec warmup 78 sec latency 2336.072 ms 2024-01-27T13:47:36.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 435 1.94 MB/sec warmup 79 sec latency 1861.732 ms 2024-01-27T13:47:37.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 441 1.94 MB/sec warmup 80 sec latency 1901.999 ms 2024-01-27T13:47:38.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 444 1.93 MB/sec warmup 81 sec latency 1816.108 ms 2024-01-27T13:47:39.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 448 1.92 MB/sec warmup 82 sec latency 2514.289 ms 2024-01-27T13:47:40.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 451 1.91 MB/sec warmup 83 sec latency 2686.950 ms 2024-01-27T13:47:41.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 457 1.91 MB/sec warmup 84 sec latency 2546.786 ms 2024-01-27T13:47:42.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 459 1.90 MB/sec warmup 85 sec latency 1788.219 ms 2024-01-27T13:47:43.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 466 1.90 MB/sec warmup 86 sec latency 1932.208 ms 2024-01-27T13:47:44.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 467 1.88 MB/sec warmup 87 sec latency 2349.148 ms 2024-01-27T13:47:45.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 474 1.89 MB/sec warmup 88 sec latency 2333.512 ms 2024-01-27T13:47:46.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 476 1.87 MB/sec warmup 89 sec latency 1672.637 ms 2024-01-27T13:47:47.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 482 1.87 MB/sec warmup 90 sec latency 1978.665 ms 2024-01-27T13:47:48.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 484 1.86 MB/sec warmup 91 sec latency 2039.214 ms 2024-01-27T13:47:49.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 491 1.86 MB/sec warmup 92 sec latency 2232.667 ms 2024-01-27T13:47:50.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 499 1.87 MB/sec warmup 93 sec latency 2226.973 ms 2024-01-27T13:47:51.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 505 1.87 MB/sec warmup 94 sec latency 1897.893 ms 2024-01-27T13:47:52.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 508 1.87 MB/sec warmup 95 sec latency 1744.009 ms 2024-01-27T13:47:53.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 511 1.85 MB/sec warmup 96 sec latency 2641.003 ms 2024-01-27T13:47:54.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 517 1.86 MB/sec warmup 97 sec latency 3641.030 ms 2024-01-27T13:47:55.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 526 1.87 MB/sec warmup 98 sec latency 4641.077 ms 2024-01-27T13:47:56.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 529 1.85 MB/sec warmup 99 sec latency 4758.220 ms 2024-01-27T13:47:57.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 537 1.87 MB/sec warmup 100 sec latency 2137.071 ms 2024-01-27T13:47:58.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 549 1.89 MB/sec warmup 101 sec latency 2832.696 ms 2024-01-27T13:47:59.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 558 1.90 MB/sec warmup 102 sec latency 2492.512 ms 2024-01-27T13:48:00.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 574 1.93 MB/sec warmup 103 sec latency 3492.543 ms 2024-01-27T13:48:01.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 582 1.94 MB/sec warmup 104 sec latency 4015.597 ms 2024-01-27T13:48:01.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:48:01.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:48:02.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 602 1.98 MB/sec warmup 105 sec latency 2691.890 ms 2024-01-27T13:48:03.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 607 1.98 MB/sec warmup 106 sec latency 3048.947 ms 2024-01-27T13:48:04.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 607 1.96 MB/sec warmup 107 sec latency 3358.087 ms 2024-01-27T13:48:05.070 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:16:32.722 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.080 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:16:32.732 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.127 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:16:32.719 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.128 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:16:32.720 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.131 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:16:32.723 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.133 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:16:32.725 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.165 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:16:32.817 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.211 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:16:32.801 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.215 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:16:32.808 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:05.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 611 1.94 MB/sec warmup 108 sec latency 3410.128 ms 2024-01-27T13:48:06.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 616 1.93 MB/sec warmup 109 sec latency 3602.502 ms 2024-01-27T13:48:07.527 INFO:tasks.workunit.client.0.smithi046.stdout: 10 618 1.91 MB/sec warmup 110 sec latency 3556.359 ms 2024-01-27T13:48:08.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 618 1.89 MB/sec warmup 111 sec latency 3043.157 ms 2024-01-27T13:48:09.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 621 1.88 MB/sec warmup 112 sec latency 3197.966 ms 2024-01-27T13:48:10.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 632 1.86 MB/sec warmup 113 sec latency 2943.969 ms 2024-01-27T13:48:11.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 636 1.85 MB/sec warmup 114 sec latency 2612.059 ms 2024-01-27T13:48:12.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 641 1.83 MB/sec warmup 115 sec latency 2801.349 ms 2024-01-27T13:48:13.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 646 1.82 MB/sec warmup 116 sec latency 2826.510 ms 2024-01-27T13:48:14.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 646 1.80 MB/sec warmup 117 sec latency 3016.700 ms 2024-01-27T13:48:15.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 647 1.79 MB/sec warmup 118 sec latency 3195.152 ms 2024-01-27T13:48:16.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 650 1.77 MB/sec warmup 119 sec latency 3071.982 ms 2024-01-27T13:48:18.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 656 0.02 MB/sec execute 1 sec latency 2746.696 ms 2024-01-27T13:48:19.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 657 0.01 MB/sec execute 2 sec latency 2888.167 ms 2024-01-27T13:48:20.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 658 0.01 MB/sec execute 3 sec latency 3562.683 ms 2024-01-27T13:48:21.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 660 0.03 MB/sec execute 4 sec latency 3312.514 ms 2024-01-27T13:48:22.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 665 0.09 MB/sec execute 5 sec latency 3385.728 ms 2024-01-27T13:48:23.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 670 0.08 MB/sec execute 6 sec latency 3334.948 ms 2024-01-27T13:48:24.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 676 0.13 MB/sec execute 7 sec latency 2371.798 ms 2024-01-27T13:48:25.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 681 0.12 MB/sec execute 8 sec latency 2923.004 ms 2024-01-27T13:48:26.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 685 0.11 MB/sec execute 9 sec latency 2899.080 ms 2024-01-27T13:48:27.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 688 0.11 MB/sec execute 10 sec latency 2966.167 ms 2024-01-27T13:48:28.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 690 0.10 MB/sec execute 11 sec latency 2674.411 ms 2024-01-27T13:48:29.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 692 0.10 MB/sec execute 12 sec latency 3330.789 ms 2024-01-27T13:48:30.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 698 0.10 MB/sec execute 13 sec latency 2998.969 ms 2024-01-27T13:48:31.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 703 0.09 MB/sec execute 14 sec latency 3028.160 ms 2024-01-27T13:48:31.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:48:31.784 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:48:32.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 709 0.09 MB/sec execute 15 sec latency 3437.496 ms 2024-01-27T13:48:33.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 713 0.09 MB/sec execute 16 sec latency 3516.823 ms 2024-01-27T13:48:34.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 715 0.08 MB/sec execute 17 sec latency 2501.382 ms 2024-01-27T13:48:35.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 717 0.08 MB/sec execute 18 sec latency 3501.414 ms 2024-01-27T13:48:36.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 722 0.09 MB/sec execute 19 sec latency 4368.473 ms 2024-01-27T13:48:37.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 728 0.10 MB/sec execute 20 sec latency 4209.072 ms 2024-01-27T13:48:38.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 736 0.11 MB/sec execute 21 sec latency 2111.416 ms 2024-01-27T13:48:39.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 740 0.11 MB/sec execute 22 sec latency 3111.442 ms 2024-01-27T13:48:40.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 744 0.10 MB/sec execute 23 sec latency 4111.471 ms 2024-01-27T13:48:41.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 747 0.10 MB/sec execute 24 sec latency 4677.478 ms 2024-01-27T13:48:42.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 751 0.10 MB/sec execute 25 sec latency 3615.290 ms 2024-01-27T13:48:43.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 755 0.10 MB/sec execute 26 sec latency 3960.178 ms 2024-01-27T13:48:44.528 INFO:tasks.workunit.client.0.smithi046.stdout: 10 755 0.09 MB/sec execute 27 sec latency 2270.218 ms 2024-01-27T13:48:45.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 758 0.09 MB/sec execute 28 sec latency 2842.272 ms 2024-01-27T13:48:46.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 762 0.09 MB/sec execute 29 sec latency 3074.491 ms 2024-01-27T13:48:47.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 772 0.10 MB/sec execute 30 sec latency 3226.550 ms 2024-01-27T13:48:48.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 779 0.10 MB/sec execute 31 sec latency 2681.704 ms 2024-01-27T13:48:49.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 781 0.10 MB/sec execute 32 sec latency 2840.027 ms 2024-01-27T13:48:49.828 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:17.481 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.834 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:17.486 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.864 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:17:17.516 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.893 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:17:17.485 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.895 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:17:17.488 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.900 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:17:17.493 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.901 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:17:17.494 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.930 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:17:17.522 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:49.932 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:17:17.524 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:48:50.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 785 0.09 MB/sec execute 33 sec latency 3840.074 ms 2024-01-27T13:48:51.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 788 0.09 MB/sec execute 34 sec latency 4528.770 ms 2024-01-27T13:48:52.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 790 0.09 MB/sec execute 35 sec latency 3812.203 ms 2024-01-27T13:48:53.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 796 0.10 MB/sec execute 36 sec latency 4812.248 ms 2024-01-27T13:48:54.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 802 0.10 MB/sec execute 37 sec latency 5644.326 ms 2024-01-27T13:48:55.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 808 0.10 MB/sec execute 38 sec latency 3056.908 ms 2024-01-27T13:48:56.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 812 0.10 MB/sec execute 39 sec latency 3699.968 ms 2024-01-27T13:48:57.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 813 0.10 MB/sec execute 40 sec latency 3070.430 ms 2024-01-27T13:48:58.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 813 0.10 MB/sec execute 41 sec latency 2930.684 ms 2024-01-27T13:48:59.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 817 0.10 MB/sec execute 42 sec latency 3024.755 ms 2024-01-27T13:49:00.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 818 0.09 MB/sec execute 43 sec latency 3146.197 ms 2024-01-27T13:49:01.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 819 0.09 MB/sec execute 44 sec latency 3131.729 ms 2024-01-27T13:49:01.913 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:49:01.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:49:02.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 821 0.09 MB/sec execute 45 sec latency 3062.140 ms 2024-01-27T13:49:03.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 822 0.09 MB/sec execute 46 sec latency 2644.399 ms 2024-01-27T13:49:04.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 826 0.09 MB/sec execute 47 sec latency 2657.856 ms 2024-01-27T13:49:05.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 831 0.09 MB/sec execute 48 sec latency 2570.739 ms 2024-01-27T13:49:06.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 835 0.09 MB/sec execute 49 sec latency 2338.515 ms 2024-01-27T13:49:07.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 841 0.09 MB/sec execute 50 sec latency 2385.428 ms 2024-01-27T13:49:08.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 851 0.10 MB/sec execute 51 sec latency 2836.826 ms 2024-01-27T13:49:09.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 854 0.09 MB/sec execute 52 sec latency 2582.945 ms 2024-01-27T13:49:10.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 856 0.09 MB/sec execute 53 sec latency 2885.062 ms 2024-01-27T13:49:11.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 857 0.09 MB/sec execute 54 sec latency 2981.877 ms 2024-01-27T13:49:12.529 INFO:tasks.workunit.client.0.smithi046.stdout: 10 858 0.09 MB/sec execute 55 sec latency 3217.500 ms 2024-01-27T13:49:13.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 860 0.09 MB/sec execute 56 sec latency 2714.122 ms 2024-01-27T13:49:14.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 862 0.09 MB/sec execute 57 sec latency 2717.106 ms 2024-01-27T13:49:15.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 865 0.09 MB/sec execute 58 sec latency 3148.283 ms 2024-01-27T13:49:16.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 868 0.09 MB/sec execute 59 sec latency 2878.593 ms 2024-01-27T13:49:17.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 871 0.09 MB/sec execute 60 sec latency 2808.577 ms 2024-01-27T13:49:18.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 874 0.09 MB/sec execute 61 sec latency 3319.957 ms 2024-01-27T13:49:19.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 877 0.09 MB/sec execute 62 sec latency 3230.932 ms 2024-01-27T13:49:20.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 880 0.09 MB/sec execute 63 sec latency 3683.139 ms 2024-01-27T13:49:21.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 884 0.09 MB/sec execute 64 sec latency 3189.047 ms 2024-01-27T13:49:22.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 889 0.09 MB/sec execute 65 sec latency 3724.415 ms 2024-01-27T13:49:23.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 893 0.09 MB/sec execute 66 sec latency 3170.325 ms 2024-01-27T13:49:24.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 897 0.09 MB/sec execute 67 sec latency 3448.919 ms 2024-01-27T13:49:25.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 899 0.09 MB/sec execute 68 sec latency 3095.403 ms 2024-01-27T13:49:26.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 904 0.09 MB/sec execute 69 sec latency 3748.341 ms 2024-01-27T13:49:27.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 909 0.09 MB/sec execute 70 sec latency 2520.725 ms 2024-01-27T13:49:28.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 913 0.09 MB/sec execute 71 sec latency 2997.033 ms 2024-01-27T13:49:29.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 916 0.09 MB/sec execute 72 sec latency 3372.623 ms 2024-01-27T13:49:30.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 917 0.09 MB/sec execute 73 sec latency 3047.888 ms 2024-01-27T13:49:31.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 919 0.09 MB/sec execute 74 sec latency 4047.920 ms 2024-01-27T13:49:32.186 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:49:32.188 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:49:32.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 925 0.09 MB/sec execute 75 sec latency 4397.521 ms 2024-01-27T13:49:33.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.09 MB/sec execute 76 sec latency 4237.922 ms 2024-01-27T13:49:34.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 928 0.09 MB/sec execute 77 sec latency 3569.380 ms 2024-01-27T13:49:35.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 929 0.09 MB/sec execute 78 sec latency 3374.788 ms 2024-01-27T13:49:36.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 929 0.09 MB/sec execute 79 sec latency 3090.935 ms 2024-01-27T13:49:37.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 930 0.09 MB/sec execute 80 sec latency 2405.494 ms 2024-01-27T13:49:38.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 931 0.09 MB/sec execute 81 sec latency 2337.567 ms 2024-01-27T13:49:39.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 933 0.08 MB/sec execute 82 sec latency 2474.654 ms 2024-01-27T13:49:40.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 935 0.08 MB/sec execute 83 sec latency 2654.487 ms 2024-01-27T13:49:41.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 937 0.08 MB/sec execute 84 sec latency 2775.066 ms 2024-01-27T13:49:42.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 939 0.08 MB/sec execute 85 sec latency 2905.651 ms 2024-01-27T13:49:43.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 941 0.08 MB/sec execute 86 sec latency 2723.002 ms 2024-01-27T13:49:44.530 INFO:tasks.workunit.client.0.smithi046.stdout: 10 945 0.08 MB/sec execute 87 sec latency 2648.360 ms 2024-01-27T13:49:45.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 948 0.08 MB/sec execute 88 sec latency 2976.202 ms 2024-01-27T13:49:46.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 951 0.08 MB/sec execute 89 sec latency 2665.545 ms 2024-01-27T13:49:47.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 958 0.09 MB/sec execute 90 sec latency 2858.290 ms 2024-01-27T13:49:48.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 962 0.09 MB/sec execute 91 sec latency 3212.596 ms 2024-01-27T13:49:49.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 967 0.09 MB/sec execute 92 sec latency 3293.985 ms 2024-01-27T13:49:50.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 969 0.09 MB/sec execute 93 sec latency 3380.973 ms 2024-01-27T13:49:51.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 972 0.09 MB/sec execute 94 sec latency 3618.340 ms 2024-01-27T13:49:52.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 978 0.10 MB/sec execute 95 sec latency 3530.068 ms 2024-01-27T13:49:53.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 986 0.10 MB/sec execute 96 sec latency 4347.341 ms 2024-01-27T13:49:54.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 992 0.11 MB/sec execute 97 sec latency 2131.999 ms 2024-01-27T13:49:55.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 996 0.11 MB/sec execute 98 sec latency 3132.034 ms 2024-01-27T13:49:56.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 997 0.11 MB/sec execute 99 sec latency 3772.545 ms 2024-01-27T13:49:57.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1002 0.11 MB/sec execute 100 sec latency 3316.949 ms 2024-01-27T13:49:58.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1010 0.13 MB/sec execute 101 sec latency 3628.554 ms 2024-01-27T13:49:59.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1015 0.13 MB/sec execute 102 sec latency 3194.554 ms 2024-01-27T13:50:00.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1018 0.14 MB/sec execute 103 sec latency 2911.309 ms 2024-01-27T13:50:01.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1020 0.14 MB/sec execute 104 sec latency 3744.962 ms 2024-01-27T13:50:02.250 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:50:02.252 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:50:02.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1022 0.14 MB/sec execute 105 sec latency 3375.822 ms 2024-01-27T13:50:03.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1028 0.15 MB/sec execute 106 sec latency 3328.154 ms 2024-01-27T13:50:04.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1034 0.17 MB/sec execute 107 sec latency 2828.268 ms 2024-01-27T13:50:05.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1035 0.17 MB/sec execute 108 sec latency 2927.956 ms 2024-01-27T13:50:06.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1037 0.17 MB/sec execute 109 sec latency 2957.055 ms 2024-01-27T13:50:07.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1040 0.16 MB/sec execute 110 sec latency 2760.931 ms 2024-01-27T13:50:08.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1043 0.16 MB/sec execute 111 sec latency 2617.549 ms 2024-01-27T13:50:09.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1044 0.16 MB/sec execute 112 sec latency 2707.879 ms 2024-01-27T13:50:10.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1044 0.16 MB/sec execute 113 sec latency 3077.877 ms 2024-01-27T13:50:11.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1048 0.16 MB/sec execute 114 sec latency 3186.232 ms 2024-01-27T13:50:12.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1050 0.16 MB/sec execute 115 sec latency 3283.794 ms 2024-01-27T13:50:13.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1052 0.16 MB/sec execute 116 sec latency 3322.584 ms 2024-01-27T13:50:14.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1053 0.15 MB/sec execute 117 sec latency 3108.007 ms 2024-01-27T13:50:15.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1055 0.15 MB/sec execute 118 sec latency 3356.354 ms 2024-01-27T13:50:16.531 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1058 0.15 MB/sec execute 119 sec latency 3291.533 ms 2024-01-27T13:50:17.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1062 0.15 MB/sec execute 120 sec latency 2775.354 ms 2024-01-27T13:50:18.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1064 0.15 MB/sec execute 121 sec latency 3240.284 ms 2024-01-27T13:50:19.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1065 0.15 MB/sec execute 122 sec latency 3227.139 ms 2024-01-27T13:50:20.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1068 0.15 MB/sec execute 123 sec latency 3832.698 ms 2024-01-27T13:50:21.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1074 0.15 MB/sec execute 124 sec latency 3958.338 ms 2024-01-27T13:50:22.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1078 0.15 MB/sec execute 125 sec latency 3831.803 ms 2024-01-27T13:50:23.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1081 0.15 MB/sec execute 126 sec latency 2889.081 ms 2024-01-27T13:50:24.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1084 0.15 MB/sec execute 127 sec latency 3663.148 ms 2024-01-27T13:50:25.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1085 0.14 MB/sec execute 128 sec latency 3293.146 ms 2024-01-27T13:50:26.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1088 0.14 MB/sec execute 129 sec latency 3853.260 ms 2024-01-27T13:50:27.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1095 0.14 MB/sec execute 130 sec latency 3679.676 ms 2024-01-27T13:50:28.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1101 0.14 MB/sec execute 131 sec latency 3266.984 ms 2024-01-27T13:50:29.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1104 0.14 MB/sec execute 132 sec latency 2224.855 ms 2024-01-27T13:50:30.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1104 0.14 MB/sec execute 133 sec latency 3224.903 ms 2024-01-27T13:50:31.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1105 0.14 MB/sec execute 134 sec latency 3915.379 ms 2024-01-27T13:50:32.364 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:50:32.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:50:32.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1111 0.14 MB/sec execute 135 sec latency 3755.921 ms 2024-01-27T13:50:33.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1114 0.14 MB/sec execute 136 sec latency 3722.055 ms 2024-01-27T13:50:34.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1118 0.14 MB/sec execute 137 sec latency 2896.635 ms 2024-01-27T13:50:35.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1121 0.14 MB/sec execute 138 sec latency 3088.343 ms 2024-01-27T13:50:36.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1125 0.14 MB/sec execute 139 sec latency 3402.584 ms 2024-01-27T13:50:37.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1130 0.14 MB/sec execute 140 sec latency 3052.813 ms 2024-01-27T13:50:38.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1135 0.13 MB/sec execute 141 sec latency 2290.205 ms 2024-01-27T13:50:39.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1138 0.13 MB/sec execute 142 sec latency 2442.904 ms 2024-01-27T13:50:40.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1141 0.13 MB/sec execute 143 sec latency 2672.231 ms 2024-01-27T13:50:41.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1146 0.13 MB/sec execute 144 sec latency 2973.891 ms 2024-01-27T13:50:42.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1149 0.13 MB/sec execute 145 sec latency 3618.277 ms 2024-01-27T13:50:43.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1152 0.13 MB/sec execute 146 sec latency 3411.420 ms 2024-01-27T13:50:44.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1156 0.13 MB/sec execute 147 sec latency 3448.526 ms 2024-01-27T13:50:45.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1159 0.13 MB/sec execute 148 sec latency 3253.768 ms 2024-01-27T13:50:46.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1162 0.13 MB/sec execute 149 sec latency 3110.519 ms 2024-01-27T13:50:47.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1165 0.13 MB/sec execute 150 sec latency 3745.708 ms 2024-01-27T13:50:48.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1167 0.13 MB/sec execute 151 sec latency 3960.266 ms 2024-01-27T13:50:49.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1169 0.13 MB/sec execute 152 sec latency 3229.060 ms 2024-01-27T13:50:50.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1170 0.13 MB/sec execute 153 sec latency 3519.051 ms 2024-01-27T13:50:51.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1171 0.13 MB/sec execute 154 sec latency 3512.087 ms 2024-01-27T13:50:52.532 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1173 0.12 MB/sec execute 155 sec latency 3088.103 ms 2024-01-27T13:50:53.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1175 0.12 MB/sec execute 156 sec latency 3282.928 ms 2024-01-27T13:50:54.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1177 0.12 MB/sec execute 157 sec latency 3063.257 ms 2024-01-27T13:50:55.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1180 0.12 MB/sec execute 158 sec latency 3416.307 ms 2024-01-27T13:50:56.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1183 0.12 MB/sec execute 159 sec latency 3167.904 ms 2024-01-27T13:50:57.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1185 0.12 MB/sec execute 160 sec latency 3421.886 ms 2024-01-27T13:50:58.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1186 0.12 MB/sec execute 161 sec latency 3044.095 ms 2024-01-27T13:50:59.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1188 0.12 MB/sec execute 162 sec latency 3183.371 ms 2024-01-27T13:51:00.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1190 0.12 MB/sec execute 163 sec latency 3154.066 ms 2024-01-27T13:51:01.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1194 0.12 MB/sec execute 164 sec latency 3975.331 ms 2024-01-27T13:51:02.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:51:02.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:51:02.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1200 0.12 MB/sec execute 165 sec latency 2844.489 ms 2024-01-27T13:51:03.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1204 0.12 MB/sec execute 166 sec latency 1038.086 ms 2024-01-27T13:51:04.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1207 0.12 MB/sec execute 167 sec latency 1365.602 ms 2024-01-27T13:51:05.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1211 0.12 MB/sec execute 168 sec latency 1881.353 ms 2024-01-27T13:51:06.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1215 0.12 MB/sec execute 169 sec latency 2881.395 ms 2024-01-27T13:51:07.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1221 0.12 MB/sec execute 170 sec latency 3317.079 ms 2024-01-27T13:51:08.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1223 0.12 MB/sec execute 171 sec latency 2790.789 ms 2024-01-27T13:51:09.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1225 0.12 MB/sec execute 172 sec latency 3279.582 ms 2024-01-27T13:51:10.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1228 0.12 MB/sec execute 173 sec latency 3578.046 ms 2024-01-27T13:51:11.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1232 0.11 MB/sec execute 174 sec latency 4227.877 ms 2024-01-27T13:51:12.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1237 0.11 MB/sec execute 175 sec latency 3896.166 ms 2024-01-27T13:51:13.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1240 0.11 MB/sec execute 176 sec latency 2403.664 ms 2024-01-27T13:51:14.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1248 0.11 MB/sec execute 177 sec latency 3403.698 ms 2024-01-27T13:51:15.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1250 0.11 MB/sec execute 178 sec latency 3681.432 ms 2024-01-27T13:51:16.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1252 0.11 MB/sec execute 179 sec latency 2975.237 ms 2024-01-27T13:51:17.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1257 0.11 MB/sec execute 180 sec latency 3297.076 ms 2024-01-27T13:51:18.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1261 0.11 MB/sec execute 181 sec latency 3046.530 ms 2024-01-27T13:51:19.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1272 0.13 MB/sec execute 182 sec latency 3713.546 ms 2024-01-27T13:51:20.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1276 0.13 MB/sec execute 183 sec latency 2562.939 ms 2024-01-27T13:51:21.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1276 0.13 MB/sec execute 184 sec latency 3562.968 ms 2024-01-27T13:51:22.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1279 0.13 MB/sec execute 185 sec latency 4562.995 ms 2024-01-27T13:51:23.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1280 0.13 MB/sec execute 186 sec latency 4658.739 ms 2024-01-27T13:51:24.533 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1281 0.12 MB/sec execute 187 sec latency 2777.491 ms 2024-01-27T13:51:25.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1287 0.12 MB/sec execute 188 sec latency 3027.447 ms 2024-01-27T13:51:26.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1289 0.12 MB/sec execute 189 sec latency 3875.803 ms 2024-01-27T13:51:27.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1290 0.12 MB/sec execute 190 sec latency 3979.826 ms 2024-01-27T13:51:28.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1290 0.12 MB/sec execute 191 sec latency 4010.541 ms 2024-01-27T13:51:29.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1292 0.12 MB/sec execute 192 sec latency 2871.684 ms 2024-01-27T13:51:30.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1310 0.15 MB/sec execute 193 sec latency 2911.033 ms 2024-01-27T13:51:31.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1311 0.15 MB/sec execute 194 sec latency 2926.813 ms 2024-01-27T13:51:32.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1311 0.15 MB/sec execute 195 sec latency 2989.672 ms 2024-01-27T13:51:32.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:51:32.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:51:33.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1324 0.17 MB/sec execute 196 sec latency 2843.664 ms 2024-01-27T13:51:34.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1340 0.19 MB/sec execute 197 sec latency 2678.708 ms 2024-01-27T13:51:35.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1350 0.20 MB/sec execute 198 sec latency 2724.285 ms 2024-01-27T13:51:36.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1351 0.20 MB/sec execute 199 sec latency 2745.108 ms 2024-01-27T13:51:37.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1353 0.20 MB/sec execute 200 sec latency 2693.455 ms 2024-01-27T13:51:38.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1380 0.24 MB/sec execute 201 sec latency 2546.249 ms 2024-01-27T13:51:39.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1382 0.24 MB/sec execute 202 sec latency 2736.679 ms 2024-01-27T13:51:40.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1383 0.24 MB/sec execute 203 sec latency 2782.964 ms 2024-01-27T13:51:41.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1384 0.24 MB/sec execute 204 sec latency 3079.865 ms 2024-01-27T13:51:42.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1385 0.24 MB/sec execute 205 sec latency 2887.158 ms 2024-01-27T13:51:43.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1388 0.24 MB/sec execute 206 sec latency 2688.378 ms 2024-01-27T13:51:44.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1391 0.24 MB/sec execute 207 sec latency 2350.454 ms 2024-01-27T13:51:45.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1392 0.24 MB/sec execute 208 sec latency 2874.072 ms 2024-01-27T13:51:46.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1395 0.24 MB/sec execute 209 sec latency 2672.333 ms 2024-01-27T13:51:47.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1398 0.23 MB/sec execute 210 sec latency 2934.710 ms 2024-01-27T13:51:48.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1401 0.23 MB/sec execute 211 sec latency 2457.106 ms 2024-01-27T13:51:49.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1404 0.23 MB/sec execute 212 sec latency 2150.966 ms 2024-01-27T13:51:50.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1405 0.23 MB/sec execute 213 sec latency 2462.209 ms 2024-01-27T13:51:51.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1410 0.23 MB/sec execute 214 sec latency 2859.765 ms 2024-01-27T13:51:52.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1413 0.23 MB/sec execute 215 sec latency 3353.463 ms 2024-01-27T13:51:53.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1416 0.23 MB/sec execute 216 sec latency 2707.464 ms 2024-01-27T13:51:54.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1421 0.23 MB/sec execute 217 sec latency 2972.245 ms 2024-01-27T13:51:55.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1425 0.23 MB/sec execute 218 sec latency 2827.794 ms 2024-01-27T13:51:56.534 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1427 0.23 MB/sec execute 219 sec latency 3090.863 ms 2024-01-27T13:51:57.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1432 0.22 MB/sec execute 220 sec latency 3686.772 ms 2024-01-27T13:51:58.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1435 0.22 MB/sec execute 221 sec latency 3882.132 ms 2024-01-27T13:51:59.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1440 0.22 MB/sec execute 222 sec latency 3241.632 ms 2024-01-27T13:52:00.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1442 0.22 MB/sec execute 223 sec latency 3382.368 ms 2024-01-27T13:52:01.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1445 0.22 MB/sec execute 224 sec latency 3579.467 ms 2024-01-27T13:52:02.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1447 0.22 MB/sec execute 225 sec latency 3878.762 ms 2024-01-27T13:52:02.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:52:02.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:52:03.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1449 0.22 MB/sec execute 226 sec latency 3874.415 ms 2024-01-27T13:52:04.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1452 0.22 MB/sec execute 227 sec latency 4195.123 ms 2024-01-27T13:52:05.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1454 0.22 MB/sec execute 228 sec latency 3132.800 ms 2024-01-27T13:52:06.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1460 0.22 MB/sec execute 229 sec latency 3428.048 ms 2024-01-27T13:52:07.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1466 0.22 MB/sec execute 230 sec latency 2568.581 ms 2024-01-27T13:52:08.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1468 0.21 MB/sec execute 231 sec latency 2649.877 ms 2024-01-27T13:52:09.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1472 0.21 MB/sec execute 232 sec latency 3157.206 ms 2024-01-27T13:52:10.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1474 0.21 MB/sec execute 233 sec latency 2951.491 ms 2024-01-27T13:52:11.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1474 0.21 MB/sec execute 234 sec latency 2772.121 ms 2024-01-27T13:52:12.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1475 0.21 MB/sec execute 235 sec latency 3537.230 ms 2024-01-27T13:52:13.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1479 0.21 MB/sec execute 236 sec latency 3543.672 ms 2024-01-27T13:52:14.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1483 0.21 MB/sec execute 237 sec latency 3827.145 ms 2024-01-27T13:52:15.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1484 0.21 MB/sec execute 238 sec latency 2832.605 ms 2024-01-27T13:52:16.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1487 0.21 MB/sec execute 239 sec latency 3189.244 ms 2024-01-27T13:52:17.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1490 0.21 MB/sec execute 240 sec latency 2843.353 ms 2024-01-27T13:52:18.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1492 0.21 MB/sec execute 241 sec latency 2591.803 ms 2024-01-27T13:52:19.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1497 0.21 MB/sec execute 242 sec latency 3008.269 ms 2024-01-27T13:52:20.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1502 0.20 MB/sec execute 243 sec latency 1986.955 ms 2024-01-27T13:52:21.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1505 0.20 MB/sec execute 244 sec latency 2987.001 ms 2024-01-27T13:52:22.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1508 0.20 MB/sec execute 245 sec latency 3266.605 ms 2024-01-27T13:52:23.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1511 0.20 MB/sec execute 246 sec latency 3690.209 ms 2024-01-27T13:52:24.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1514 0.20 MB/sec execute 247 sec latency 3965.548 ms 2024-01-27T13:52:25.535 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1516 0.20 MB/sec execute 248 sec latency 3204.243 ms 2024-01-27T13:52:26.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1519 0.20 MB/sec execute 249 sec latency 2473.874 ms 2024-01-27T13:52:27.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1521 0.20 MB/sec execute 250 sec latency 2913.187 ms 2024-01-27T13:52:28.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1522 0.20 MB/sec execute 251 sec latency 2690.470 ms 2024-01-27T13:52:29.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1525 0.20 MB/sec execute 252 sec latency 3175.443 ms 2024-01-27T13:52:30.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1530 0.20 MB/sec execute 253 sec latency 2991.215 ms 2024-01-27T13:52:31.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1535 0.20 MB/sec execute 254 sec latency 3315.261 ms 2024-01-27T13:52:32.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1538 0.20 MB/sec execute 255 sec latency 3714.169 ms 2024-01-27T13:52:32.747 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:52:32.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:52:33.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1542 0.20 MB/sec execute 256 sec latency 1988.312 ms 2024-01-27T13:52:34.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1544 0.20 MB/sec execute 257 sec latency 2988.370 ms 2024-01-27T13:52:35.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1548 0.19 MB/sec execute 258 sec latency 3457.671 ms 2024-01-27T13:52:36.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1550 0.19 MB/sec execute 259 sec latency 3581.281 ms 2024-01-27T13:52:37.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1554 0.19 MB/sec execute 260 sec latency 4073.286 ms 2024-01-27T13:52:38.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1559 0.19 MB/sec execute 261 sec latency 2522.006 ms 2024-01-27T13:52:39.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1562 0.19 MB/sec execute 262 sec latency 3522.032 ms 2024-01-27T13:52:40.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1563 0.19 MB/sec execute 263 sec latency 4150.911 ms 2024-01-27T13:52:41.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1566 0.19 MB/sec execute 264 sec latency 4159.720 ms 2024-01-27T13:52:42.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1568 0.19 MB/sec execute 265 sec latency 3024.714 ms 2024-01-27T13:52:43.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1571 0.19 MB/sec execute 266 sec latency 2250.970 ms 2024-01-27T13:52:44.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1575 0.19 MB/sec execute 267 sec latency 2927.200 ms 2024-01-27T13:52:45.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1580 0.19 MB/sec execute 268 sec latency 3115.758 ms 2024-01-27T13:52:46.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1584 0.19 MB/sec execute 269 sec latency 3595.360 ms 2024-01-27T13:52:47.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1588 0.19 MB/sec execute 270 sec latency 2343.650 ms 2024-01-27T13:52:48.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1592 0.19 MB/sec execute 271 sec latency 2228.137 ms 2024-01-27T13:52:49.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1595 0.19 MB/sec execute 272 sec latency 2564.381 ms 2024-01-27T13:52:50.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1598 0.19 MB/sec execute 273 sec latency 2601.799 ms 2024-01-27T13:52:51.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1599 0.19 MB/sec execute 274 sec latency 3601.845 ms 2024-01-27T13:52:52.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1603 0.18 MB/sec execute 275 sec latency 4027.406 ms 2024-01-27T13:52:53.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1606 0.18 MB/sec execute 276 sec latency 3461.146 ms 2024-01-27T13:52:54.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1606 0.18 MB/sec execute 277 sec latency 2115.053 ms 2024-01-27T13:52:55.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1607 0.18 MB/sec execute 278 sec latency 2722.934 ms 2024-01-27T13:52:56.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1612 0.18 MB/sec execute 279 sec latency 2743.153 ms 2024-01-27T13:52:57.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1616 0.18 MB/sec execute 280 sec latency 2096.319 ms 2024-01-27T13:52:58.536 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1618 0.18 MB/sec execute 281 sec latency 1896.773 ms 2024-01-27T13:52:59.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1622 0.18 MB/sec execute 282 sec latency 2425.449 ms 2024-01-27T13:53:00.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1623 0.18 MB/sec execute 283 sec latency 3204.509 ms 2024-01-27T13:53:01.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1628 0.18 MB/sec execute 284 sec latency 3468.221 ms 2024-01-27T13:53:02.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1636 0.18 MB/sec execute 285 sec latency 2423.186 ms 2024-01-27T13:53:02.812 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:53:02.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:53:03.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1638 0.18 MB/sec execute 286 sec latency 2121.127 ms 2024-01-27T13:53:04.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1639 0.18 MB/sec execute 287 sec latency 2533.728 ms 2024-01-27T13:53:05.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1640 0.18 MB/sec execute 288 sec latency 2863.933 ms 2024-01-27T13:53:06.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1642 0.18 MB/sec execute 289 sec latency 3032.571 ms 2024-01-27T13:53:07.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1644 0.18 MB/sec execute 290 sec latency 2661.268 ms 2024-01-27T13:53:08.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1647 0.18 MB/sec execute 291 sec latency 3124.777 ms 2024-01-27T13:53:09.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1650 0.17 MB/sec execute 292 sec latency 3475.644 ms 2024-01-27T13:53:10.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1656 0.17 MB/sec execute 293 sec latency 3339.065 ms 2024-01-27T13:53:11.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1661 0.17 MB/sec execute 294 sec latency 2369.139 ms 2024-01-27T13:53:12.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1666 0.17 MB/sec execute 295 sec latency 3369.169 ms 2024-01-27T13:53:13.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1676 0.17 MB/sec execute 296 sec latency 3525.304 ms 2024-01-27T13:53:14.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1682 0.17 MB/sec execute 297 sec latency 3631.897 ms 2024-01-27T13:53:15.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1682 0.17 MB/sec execute 298 sec latency 4631.931 ms 2024-01-27T13:53:16.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1684 0.17 MB/sec execute 299 sec latency 5153.429 ms 2024-01-27T13:53:17.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1688 0.17 MB/sec execute 300 sec latency 4725.815 ms 2024-01-27T13:53:18.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1690 0.17 MB/sec execute 301 sec latency 5285.973 ms 2024-01-27T13:53:19.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1691 0.17 MB/sec execute 302 sec latency 4960.255 ms 2024-01-27T13:53:20.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1692 0.17 MB/sec execute 303 sec latency 4963.539 ms 2024-01-27T13:53:21.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1693 0.17 MB/sec execute 304 sec latency 5194.800 ms 2024-01-27T13:53:22.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1695 0.17 MB/sec execute 305 sec latency 5203.027 ms 2024-01-27T13:53:23.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1699 0.17 MB/sec execute 306 sec latency 5306.319 ms 2024-01-27T13:53:24.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1705 0.17 MB/sec execute 307 sec latency 4313.202 ms 2024-01-27T13:53:25.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1708 0.17 MB/sec execute 308 sec latency 1138.529 ms 2024-01-27T13:53:26.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1713 0.17 MB/sec execute 309 sec latency 1922.745 ms 2024-01-27T13:53:27.537 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1717 0.17 MB/sec execute 310 sec latency 2922.796 ms 2024-01-27T13:53:28.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1721 0.17 MB/sec execute 311 sec latency 3881.538 ms 2024-01-27T13:53:29.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1729 0.17 MB/sec execute 312 sec latency 4052.147 ms 2024-01-27T13:53:30.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1732 0.17 MB/sec execute 313 sec latency 3138.581 ms 2024-01-27T13:53:31.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1735 0.16 MB/sec execute 314 sec latency 4138.613 ms 2024-01-27T13:53:32.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1737 0.16 MB/sec execute 315 sec latency 5138.644 ms 2024-01-27T13:53:32.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:53:32.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:53:33.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1746 0.16 MB/sec execute 316 sec latency 5391.378 ms 2024-01-27T13:53:34.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1755 0.16 MB/sec execute 317 sec latency 6057.798 ms 2024-01-27T13:53:35.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1755 0.16 MB/sec execute 318 sec latency 6232.439 ms 2024-01-27T13:53:36.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1756 0.16 MB/sec execute 319 sec latency 6646.496 ms 2024-01-27T13:53:37.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1759 0.16 MB/sec execute 320 sec latency 5809.078 ms 2024-01-27T13:53:38.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1761 0.16 MB/sec execute 321 sec latency 4645.576 ms 2024-01-27T13:53:39.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1762 0.16 MB/sec execute 322 sec latency 3509.042 ms 2024-01-27T13:53:40.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1765 0.16 MB/sec execute 323 sec latency 3992.013 ms 2024-01-27T13:53:41.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1769 0.16 MB/sec execute 324 sec latency 4325.887 ms 2024-01-27T13:53:42.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1772 0.16 MB/sec execute 325 sec latency 4889.946 ms 2024-01-27T13:53:43.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1779 0.16 MB/sec execute 326 sec latency 2369.665 ms 2024-01-27T13:53:44.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1784 0.16 MB/sec execute 327 sec latency 3369.713 ms 2024-01-27T13:53:45.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1787 0.16 MB/sec execute 328 sec latency 3634.939 ms 2024-01-27T13:53:46.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1790 0.16 MB/sec execute 329 sec latency 3002.416 ms 2024-01-27T13:53:47.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1798 0.16 MB/sec execute 330 sec latency 3146.997 ms 2024-01-27T13:53:48.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1802 0.16 MB/sec execute 331 sec latency 1232.380 ms 2024-01-27T13:53:49.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1804 0.16 MB/sec execute 332 sec latency 2232.426 ms 2024-01-27T13:53:50.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1806 0.16 MB/sec execute 333 sec latency 3176.433 ms 2024-01-27T13:53:51.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1809 0.16 MB/sec execute 334 sec latency 3635.477 ms 2024-01-27T13:53:52.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1813 0.16 MB/sec execute 335 sec latency 3583.972 ms 2024-01-27T13:53:53.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1814 0.16 MB/sec execute 336 sec latency 3534.813 ms 2024-01-27T13:53:54.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1816 0.16 MB/sec execute 337 sec latency 2740.402 ms 2024-01-27T13:53:55.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1819 0.16 MB/sec execute 338 sec latency 3688.568 ms 2024-01-27T13:53:56.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1823 0.15 MB/sec execute 339 sec latency 3484.576 ms 2024-01-27T13:53:57.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1826 0.15 MB/sec execute 340 sec latency 3243.425 ms 2024-01-27T13:53:58.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1828 0.15 MB/sec execute 341 sec latency 2382.191 ms 2024-01-27T13:53:59.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1830 0.15 MB/sec execute 342 sec latency 2278.317 ms 2024-01-27T13:54:00.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1834 0.15 MB/sec execute 343 sec latency 2920.823 ms 2024-01-27T13:54:01.538 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1837 0.15 MB/sec execute 344 sec latency 2153.336 ms 2024-01-27T13:54:02.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1840 0.15 MB/sec execute 345 sec latency 2603.827 ms 2024-01-27T13:54:03.028 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:54:03.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:54:03.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1841 0.15 MB/sec execute 346 sec latency 2776.187 ms 2024-01-27T13:54:04.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1842 0.15 MB/sec execute 347 sec latency 2938.844 ms 2024-01-27T13:54:05.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1848 0.15 MB/sec execute 348 sec latency 2858.609 ms 2024-01-27T13:54:06.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1852 0.15 MB/sec execute 349 sec latency 1463.477 ms 2024-01-27T13:54:07.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1854 0.15 MB/sec execute 350 sec latency 2463.506 ms 2024-01-27T13:54:08.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1856 0.15 MB/sec execute 351 sec latency 2856.996 ms 2024-01-27T13:54:09.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1860 0.15 MB/sec execute 352 sec latency 2896.052 ms 2024-01-27T13:54:10.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1862 0.15 MB/sec execute 353 sec latency 1027.186 ms 2024-01-27T13:54:11.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1862 0.15 MB/sec execute 354 sec latency 2027.232 ms 2024-01-27T13:54:12.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1864 0.15 MB/sec execute 355 sec latency 2601.072 ms 2024-01-27T13:54:13.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1870 0.15 MB/sec execute 356 sec latency 2888.578 ms 2024-01-27T13:54:14.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1873 0.15 MB/sec execute 357 sec latency 1655.470 ms 2024-01-27T13:54:15.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1878 0.15 MB/sec execute 358 sec latency 2064.261 ms 2024-01-27T13:54:16.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1880 0.15 MB/sec execute 359 sec latency 2494.488 ms 2024-01-27T13:54:17.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1881 0.15 MB/sec execute 360 sec latency 2537.821 ms 2024-01-27T13:54:18.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1890 0.15 MB/sec execute 361 sec latency 2585.235 ms 2024-01-27T13:54:19.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1897 0.15 MB/sec execute 362 sec latency 2512.313 ms 2024-01-27T13:54:20.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1898 0.15 MB/sec execute 363 sec latency 2651.994 ms 2024-01-27T13:54:21.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1901 0.15 MB/sec execute 364 sec latency 2721.533 ms 2024-01-27T13:54:22.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1905 0.15 MB/sec execute 365 sec latency 3136.172 ms 2024-01-27T13:54:23.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1905 0.15 MB/sec execute 366 sec latency 2893.961 ms 2024-01-27T13:54:24.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1906 0.15 MB/sec execute 367 sec latency 3002.235 ms 2024-01-27T13:54:25.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1910 0.15 MB/sec execute 368 sec latency 3241.976 ms 2024-01-27T13:54:26.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1916 0.15 MB/sec execute 369 sec latency 3366.236 ms 2024-01-27T13:54:27.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1919 0.14 MB/sec execute 370 sec latency 1855.223 ms 2024-01-27T13:54:28.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1920 0.14 MB/sec execute 371 sec latency 2343.587 ms 2024-01-27T13:54:29.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1927 0.14 MB/sec execute 372 sec latency 2771.764 ms 2024-01-27T13:54:30.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1936 0.14 MB/sec execute 373 sec latency 3183.731 ms 2024-01-27T13:54:31.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1940 0.14 MB/sec execute 374 sec latency 2246.442 ms 2024-01-27T13:54:32.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1941 0.14 MB/sec execute 375 sec latency 3246.474 ms 2024-01-27T13:54:33.118 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:54:33.121 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:54:33.539 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1943 0.14 MB/sec execute 376 sec latency 3846.367 ms 2024-01-27T13:54:34.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1945 0.14 MB/sec execute 377 sec latency 3784.818 ms 2024-01-27T13:54:35.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1951 0.14 MB/sec execute 378 sec latency 4115.277 ms 2024-01-27T13:54:36.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1958 0.14 MB/sec execute 379 sec latency 4174.085 ms 2024-01-27T13:54:37.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1963 0.14 MB/sec execute 380 sec latency 4268.502 ms 2024-01-27T13:54:38.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1966 0.14 MB/sec execute 381 sec latency 4926.824 ms 2024-01-27T13:54:39.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1971 0.14 MB/sec execute 382 sec latency 5120.616 ms 2024-01-27T13:54:40.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1974 0.14 MB/sec execute 383 sec latency 4223.250 ms 2024-01-27T13:54:41.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1975 0.14 MB/sec execute 384 sec latency 4326.041 ms 2024-01-27T13:54:42.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1976 0.14 MB/sec execute 385 sec latency 4095.540 ms 2024-01-27T13:54:43.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1978 0.14 MB/sec execute 386 sec latency 4328.589 ms 2024-01-27T13:54:44.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1982 0.14 MB/sec execute 387 sec latency 4312.505 ms 2024-01-27T13:54:45.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1984 0.14 MB/sec execute 388 sec latency 4870.441 ms 2024-01-27T13:54:46.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1988 0.14 MB/sec execute 389 sec latency 4992.886 ms 2024-01-27T13:54:47.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 1993 0.14 MB/sec execute 390 sec latency 5073.755 ms 2024-01-27T13:54:48.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2001 0.14 MB/sec execute 391 sec latency 2330.155 ms 2024-01-27T13:54:49.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2006 0.14 MB/sec execute 392 sec latency 3330.183 ms 2024-01-27T13:54:50.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2009 0.14 MB/sec execute 393 sec latency 3866.396 ms 2024-01-27T13:54:51.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2011 0.14 MB/sec execute 394 sec latency 3402.004 ms 2024-01-27T13:54:52.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2013 0.14 MB/sec execute 395 sec latency 2643.104 ms 2024-01-27T13:54:53.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2015 0.14 MB/sec execute 396 sec latency 3458.912 ms 2024-01-27T13:54:54.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2016 0.14 MB/sec execute 397 sec latency 4458.958 ms 2024-01-27T13:54:55.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2020 0.14 MB/sec execute 398 sec latency 5254.322 ms 2024-01-27T13:54:56.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2026 0.14 MB/sec execute 399 sec latency 5270.010 ms 2024-01-27T13:54:57.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2028 0.14 MB/sec execute 400 sec latency 1916.656 ms 2024-01-27T13:54:58.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2030 0.14 MB/sec execute 401 sec latency 2916.688 ms 2024-01-27T13:54:59.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2034 0.14 MB/sec execute 402 sec latency 3050.036 ms 2024-01-27T13:55:00.138 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:23:27.793 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.142 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:23:27.797 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.144 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:23:27.739 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.145 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:23:27.740 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.146 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:23:27.741 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.148 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:23:27.743 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.280 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:23:27.874 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.282 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:23:27.876 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.282 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:23:27.937 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:00.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2037 0.14 MB/sec execute 403 sec latency 2647.577 ms 2024-01-27T13:55:01.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2038 0.14 MB/sec execute 404 sec latency 2809.475 ms 2024-01-27T13:55:02.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2041 0.14 MB/sec execute 405 sec latency 2998.100 ms 2024-01-27T13:55:03.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:55:03.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:55:03.540 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2045 0.14 MB/sec execute 406 sec latency 3177.607 ms 2024-01-27T13:55:04.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2048 0.14 MB/sec execute 407 sec latency 3041.565 ms 2024-01-27T13:55:05.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2049 0.14 MB/sec execute 408 sec latency 3460.281 ms 2024-01-27T13:55:06.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2051 0.14 MB/sec execute 409 sec latency 3357.371 ms 2024-01-27T13:55:07.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2053 0.13 MB/sec execute 410 sec latency 3129.373 ms 2024-01-27T13:55:08.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2055 0.13 MB/sec execute 411 sec latency 2583.259 ms 2024-01-27T13:55:09.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2056 0.13 MB/sec execute 412 sec latency 2748.218 ms 2024-01-27T13:55:10.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2058 0.13 MB/sec execute 413 sec latency 2885.273 ms 2024-01-27T13:55:11.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2063 0.13 MB/sec execute 414 sec latency 2966.380 ms 2024-01-27T13:55:12.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2065 0.13 MB/sec execute 415 sec latency 2901.934 ms 2024-01-27T13:55:13.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2067 0.13 MB/sec execute 416 sec latency 3021.656 ms 2024-01-27T13:55:14.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2068 0.13 MB/sec execute 417 sec latency 3053.704 ms 2024-01-27T13:55:15.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2072 0.13 MB/sec execute 418 sec latency 3026.053 ms 2024-01-27T13:55:16.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2075 0.13 MB/sec execute 419 sec latency 2991.859 ms 2024-01-27T13:55:17.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2079 0.13 MB/sec execute 420 sec latency 2961.250 ms 2024-01-27T13:55:18.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2081 0.13 MB/sec execute 421 sec latency 3134.368 ms 2024-01-27T13:55:19.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2085 0.13 MB/sec execute 422 sec latency 3270.348 ms 2024-01-27T13:55:20.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2086 0.13 MB/sec execute 423 sec latency 2538.578 ms 2024-01-27T13:55:21.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2089 0.13 MB/sec execute 424 sec latency 2199.026 ms 2024-01-27T13:55:22.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2090 0.13 MB/sec execute 425 sec latency 3131.422 ms 2024-01-27T13:55:23.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2091 0.13 MB/sec execute 426 sec latency 3564.394 ms 2024-01-27T13:55:24.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2093 0.13 MB/sec execute 427 sec latency 3607.913 ms 2024-01-27T13:55:25.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2098 0.13 MB/sec execute 428 sec latency 3801.381 ms 2024-01-27T13:55:26.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2104 0.13 MB/sec execute 429 sec latency 2640.744 ms 2024-01-27T13:55:27.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2112 0.13 MB/sec execute 430 sec latency 1893.346 ms 2024-01-27T13:55:28.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2114 0.13 MB/sec execute 431 sec latency 2532.238 ms 2024-01-27T13:55:29.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2119 0.13 MB/sec execute 432 sec latency 2877.913 ms 2024-01-27T13:55:30.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2124 0.13 MB/sec execute 433 sec latency 3002.687 ms 2024-01-27T13:55:31.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2130 0.13 MB/sec execute 434 sec latency 2787.678 ms 2024-01-27T13:55:32.541 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2131 0.13 MB/sec execute 435 sec latency 2810.154 ms 2024-01-27T13:55:33.233 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:55:33.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:55:33.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2132 0.13 MB/sec execute 436 sec latency 3006.227 ms 2024-01-27T13:55:34.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2133 0.13 MB/sec execute 437 sec latency 3781.818 ms 2024-01-27T13:55:35.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2136 0.13 MB/sec execute 438 sec latency 4509.642 ms 2024-01-27T13:55:36.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2138 0.13 MB/sec execute 439 sec latency 5255.895 ms 2024-01-27T13:55:37.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2139 0.13 MB/sec execute 440 sec latency 5303.089 ms 2024-01-27T13:55:38.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2141 0.13 MB/sec execute 441 sec latency 6184.407 ms 2024-01-27T13:55:39.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2144 0.13 MB/sec execute 442 sec latency 6431.616 ms 2024-01-27T13:55:40.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2146 0.13 MB/sec execute 443 sec latency 4894.069 ms 2024-01-27T13:55:41.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2148 0.13 MB/sec execute 444 sec latency 5515.157 ms 2024-01-27T13:55:42.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2154 0.13 MB/sec execute 445 sec latency 4584.742 ms 2024-01-27T13:55:43.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2158 0.13 MB/sec execute 446 sec latency 4009.550 ms 2024-01-27T13:55:44.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2165 0.13 MB/sec execute 447 sec latency 3634.251 ms 2024-01-27T13:55:45.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2166 0.13 MB/sec execute 448 sec latency 2695.841 ms 2024-01-27T13:55:46.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2170 0.13 MB/sec execute 449 sec latency 2419.344 ms 2024-01-27T13:55:47.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2172 0.13 MB/sec execute 450 sec latency 3101.634 ms 2024-01-27T13:55:48.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2173 0.13 MB/sec execute 451 sec latency 3173.202 ms 2024-01-27T13:55:49.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2179 0.13 MB/sec execute 452 sec latency 2988.807 ms 2024-01-27T13:55:50.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2180 0.12 MB/sec execute 453 sec latency 3153.438 ms 2024-01-27T13:55:51.122 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:18.777 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.180 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:18.835 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.217 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:24:18.872 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.234 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:24:18.828 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.235 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:24:18.830 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.240 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:24:18.835 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.241 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:24:18.836 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.274 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:24:18.869 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.277 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:24:18.872 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:55:51.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2182 0.13 MB/sec execute 454 sec latency 3810.630 ms 2024-01-27T13:55:52.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2186 0.13 MB/sec execute 455 sec latency 4443.531 ms 2024-01-27T13:55:53.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2188 0.13 MB/sec execute 456 sec latency 3101.324 ms 2024-01-27T13:55:54.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2193 0.13 MB/sec execute 457 sec latency 3336.155 ms 2024-01-27T13:55:55.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2196 0.13 MB/sec execute 458 sec latency 2686.524 ms 2024-01-27T13:55:56.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2198 0.13 MB/sec execute 459 sec latency 3058.846 ms 2024-01-27T13:55:57.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2202 0.13 MB/sec execute 460 sec latency 2595.236 ms 2024-01-27T13:55:58.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2207 0.13 MB/sec execute 461 sec latency 2292.965 ms 2024-01-27T13:55:59.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2212 0.13 MB/sec execute 462 sec latency 2356.595 ms 2024-01-27T13:56:00.542 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2214 0.12 MB/sec execute 463 sec latency 2305.111 ms 2024-01-27T13:56:01.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2221 0.12 MB/sec execute 464 sec latency 2612.091 ms 2024-01-27T13:56:02.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2232 0.12 MB/sec execute 465 sec latency 2586.061 ms 2024-01-27T13:56:03.373 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:56:03.376 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:56:03.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2235 0.12 MB/sec execute 466 sec latency 3443.314 ms 2024-01-27T13:56:04.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2248 0.13 MB/sec execute 467 sec latency 3211.287 ms 2024-01-27T13:56:05.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2256 0.13 MB/sec execute 468 sec latency 3641.662 ms 2024-01-27T13:56:06.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2261 0.13 MB/sec execute 469 sec latency 3847.375 ms 2024-01-27T13:56:07.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2266 0.13 MB/sec execute 470 sec latency 3471.707 ms 2024-01-27T13:56:08.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2266 0.13 MB/sec execute 471 sec latency 3978.263 ms 2024-01-27T13:56:09.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2270 0.13 MB/sec execute 472 sec latency 4640.844 ms 2024-01-27T13:56:10.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2276 0.13 MB/sec execute 473 sec latency 5229.962 ms 2024-01-27T13:56:11.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2278 0.14 MB/sec execute 474 sec latency 4984.445 ms 2024-01-27T13:56:12.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2283 0.14 MB/sec execute 475 sec latency 5596.320 ms 2024-01-27T13:56:13.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2285 0.14 MB/sec execute 476 sec latency 3587.219 ms 2024-01-27T13:56:14.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2290 0.14 MB/sec execute 477 sec latency 3743.898 ms 2024-01-27T13:56:15.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2292 0.14 MB/sec execute 478 sec latency 3376.342 ms 2024-01-27T13:56:16.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2298 0.14 MB/sec execute 479 sec latency 3613.001 ms 2024-01-27T13:56:17.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2301 0.14 MB/sec execute 480 sec latency 3205.263 ms 2024-01-27T13:56:18.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2305 0.14 MB/sec execute 481 sec latency 2922.611 ms 2024-01-27T13:56:19.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2306 0.14 MB/sec execute 482 sec latency 3014.424 ms 2024-01-27T13:56:20.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2307 0.14 MB/sec execute 483 sec latency 2728.860 ms 2024-01-27T13:56:21.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2307 0.14 MB/sec execute 484 sec latency 2969.770 ms 2024-01-27T13:56:22.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2308 0.14 MB/sec execute 485 sec latency 3319.168 ms 2024-01-27T13:56:23.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2314 0.14 MB/sec execute 486 sec latency 3557.806 ms 2024-01-27T13:56:24.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2315 0.14 MB/sec execute 487 sec latency 3546.100 ms 2024-01-27T13:56:25.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2317 0.14 MB/sec execute 488 sec latency 3484.878 ms 2024-01-27T13:56:26.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2321 0.14 MB/sec execute 489 sec latency 2859.053 ms 2024-01-27T13:56:27.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2323 0.14 MB/sec execute 490 sec latency 2532.329 ms 2024-01-27T13:56:28.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2324 0.14 MB/sec execute 491 sec latency 2566.303 ms 2024-01-27T13:56:29.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2329 0.14 MB/sec execute 492 sec latency 2523.939 ms 2024-01-27T13:56:30.543 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2330 0.14 MB/sec execute 493 sec latency 2940.576 ms 2024-01-27T13:56:31.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2331 0.14 MB/sec execute 494 sec latency 2868.492 ms 2024-01-27T13:56:32.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2333 0.14 MB/sec execute 495 sec latency 3621.530 ms 2024-01-27T13:56:33.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2335 0.14 MB/sec execute 496 sec latency 3349.351 ms 2024-01-27T13:56:33.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:56:33.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:56:34.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2336 0.14 MB/sec execute 497 sec latency 2737.892 ms 2024-01-27T13:56:35.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2337 0.14 MB/sec execute 498 sec latency 3450.643 ms 2024-01-27T13:56:36.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2338 0.14 MB/sec execute 499 sec latency 3346.607 ms 2024-01-27T13:56:37.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2342 0.14 MB/sec execute 500 sec latency 3538.781 ms 2024-01-27T13:56:38.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2346 0.14 MB/sec execute 501 sec latency 3333.068 ms 2024-01-27T13:56:39.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2348 0.14 MB/sec execute 502 sec latency 3388.777 ms 2024-01-27T13:56:40.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2351 0.13 MB/sec execute 503 sec latency 3374.011 ms 2024-01-27T13:56:41.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2352 0.13 MB/sec execute 504 sec latency 3403.050 ms 2024-01-27T13:56:42.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2354 0.13 MB/sec execute 505 sec latency 3403.887 ms 2024-01-27T13:56:43.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2356 0.13 MB/sec execute 506 sec latency 3471.783 ms 2024-01-27T13:56:44.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2359 0.13 MB/sec execute 507 sec latency 3165.740 ms 2024-01-27T13:56:45.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2361 0.13 MB/sec execute 508 sec latency 3200.816 ms 2024-01-27T13:56:46.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2363 0.13 MB/sec execute 509 sec latency 3067.601 ms 2024-01-27T13:56:47.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2363 0.13 MB/sec execute 510 sec latency 2964.974 ms 2024-01-27T13:56:48.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2365 0.13 MB/sec execute 511 sec latency 3099.473 ms 2024-01-27T13:56:49.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2367 0.13 MB/sec execute 512 sec latency 2772.083 ms 2024-01-27T13:56:50.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2368 0.13 MB/sec execute 513 sec latency 2552.405 ms 2024-01-27T13:56:51.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2369 0.13 MB/sec execute 514 sec latency 2801.952 ms 2024-01-27T13:56:52.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2370 0.13 MB/sec execute 515 sec latency 3165.809 ms 2024-01-27T13:56:53.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2371 0.13 MB/sec execute 516 sec latency 3059.156 ms 2024-01-27T13:56:54.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2372 0.13 MB/sec execute 517 sec latency 2968.189 ms 2024-01-27T13:56:55.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2375 0.13 MB/sec execute 518 sec latency 2823.753 ms 2024-01-27T13:56:56.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2379 0.13 MB/sec execute 519 sec latency 3098.612 ms 2024-01-27T13:56:57.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2382 0.13 MB/sec execute 520 sec latency 2878.922 ms 2024-01-27T13:56:58.544 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2384 0.13 MB/sec execute 521 sec latency 3449.426 ms 2024-01-27T13:56:59.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2385 0.13 MB/sec execute 522 sec latency 3447.570 ms 2024-01-27T13:57:00.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2388 0.13 MB/sec execute 523 sec latency 3529.360 ms 2024-01-27T13:57:01.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2391 0.13 MB/sec execute 524 sec latency 3160.025 ms 2024-01-27T13:57:02.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2392 0.13 MB/sec execute 525 sec latency 3311.098 ms 2024-01-27T13:57:03.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2395 0.13 MB/sec execute 526 sec latency 3406.630 ms 2024-01-27T13:57:03.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:57:03.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:57:04.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2398 0.13 MB/sec execute 527 sec latency 3221.319 ms 2024-01-27T13:57:05.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2400 0.13 MB/sec execute 528 sec latency 2494.195 ms 2024-01-27T13:57:06.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2402 0.13 MB/sec execute 529 sec latency 3494.226 ms 2024-01-27T13:57:07.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2405 0.13 MB/sec execute 530 sec latency 3617.342 ms 2024-01-27T13:57:08.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2408 0.13 MB/sec execute 531 sec latency 3310.193 ms 2024-01-27T13:57:09.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2412 0.13 MB/sec execute 532 sec latency 3382.883 ms 2024-01-27T13:57:10.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2414 0.13 MB/sec execute 533 sec latency 3064.575 ms 2024-01-27T13:57:11.467 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:39.122 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.471 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:39.126 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.511 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:25:39.166 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.526 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:25:39.121 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.529 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:25:39.125 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.533 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:25:39.128 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.534 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:25:39.130 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2418 0.13 MB/sec execute 534 sec latency 3461.366 ms 2024-01-27T13:57:11.575 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:25:39.169 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:11.575 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:25:39.170 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:57:12.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2421 0.13 MB/sec execute 535 sec latency 3905.129 ms 2024-01-27T13:57:13.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2424 0.13 MB/sec execute 536 sec latency 4264.111 ms 2024-01-27T13:57:14.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2426 0.13 MB/sec execute 537 sec latency 3231.177 ms 2024-01-27T13:57:15.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2427 0.13 MB/sec execute 538 sec latency 3968.347 ms 2024-01-27T13:57:16.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2430 0.13 MB/sec execute 539 sec latency 3670.125 ms 2024-01-27T13:57:17.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2432 0.13 MB/sec execute 540 sec latency 3386.081 ms 2024-01-27T13:57:18.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2434 0.13 MB/sec execute 541 sec latency 3378.375 ms 2024-01-27T13:57:19.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2436 0.13 MB/sec execute 542 sec latency 3202.771 ms 2024-01-27T13:57:20.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2438 0.13 MB/sec execute 543 sec latency 3210.414 ms 2024-01-27T13:57:21.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2441 0.13 MB/sec execute 544 sec latency 2825.001 ms 2024-01-27T13:57:22.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2443 0.13 MB/sec execute 545 sec latency 2887.384 ms 2024-01-27T13:57:23.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2444 0.13 MB/sec execute 546 sec latency 3577.290 ms 2024-01-27T13:57:24.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2447 0.13 MB/sec execute 547 sec latency 3649.100 ms 2024-01-27T13:57:25.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2449 0.13 MB/sec execute 548 sec latency 3462.355 ms 2024-01-27T13:57:26.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2454 0.13 MB/sec execute 549 sec latency 2928.325 ms 2024-01-27T13:57:27.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2455 0.13 MB/sec execute 550 sec latency 3761.852 ms 2024-01-27T13:57:28.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2460 0.13 MB/sec execute 551 sec latency 3357.433 ms 2024-01-27T13:57:29.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2463 0.13 MB/sec execute 552 sec latency 3946.052 ms 2024-01-27T13:57:30.545 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2465 0.13 MB/sec execute 553 sec latency 2886.979 ms 2024-01-27T13:57:31.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2469 0.13 MB/sec execute 554 sec latency 3462.694 ms 2024-01-27T13:57:32.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2476 0.13 MB/sec execute 555 sec latency 3457.013 ms 2024-01-27T13:57:33.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2480 0.13 MB/sec execute 556 sec latency 4065.946 ms 2024-01-27T13:57:33.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:57:33.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:57:34.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2483 0.13 MB/sec execute 557 sec latency 4201.770 ms 2024-01-27T13:57:35.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2485 0.13 MB/sec execute 558 sec latency 4213.869 ms 2024-01-27T13:57:36.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2490 0.14 MB/sec execute 559 sec latency 4277.529 ms 2024-01-27T13:57:37.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2492 0.14 MB/sec execute 560 sec latency 3907.085 ms 2024-01-27T13:57:38.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2493 0.14 MB/sec execute 561 sec latency 4333.569 ms 2024-01-27T13:57:39.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2494 0.14 MB/sec execute 562 sec latency 3382.376 ms 2024-01-27T13:57:40.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2495 0.14 MB/sec execute 563 sec latency 3513.805 ms 2024-01-27T13:57:41.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2500 0.14 MB/sec execute 564 sec latency 2859.067 ms 2024-01-27T13:57:42.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2502 0.14 MB/sec execute 565 sec latency 2306.893 ms 2024-01-27T13:57:43.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2504 0.14 MB/sec execute 566 sec latency 2682.340 ms 2024-01-27T13:57:44.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2506 0.14 MB/sec execute 567 sec latency 2755.669 ms 2024-01-27T13:57:45.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2513 0.14 MB/sec execute 568 sec latency 2040.781 ms 2024-01-27T13:57:46.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2519 0.14 MB/sec execute 569 sec latency 2414.631 ms 2024-01-27T13:57:47.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2519 0.14 MB/sec execute 570 sec latency 2534.763 ms 2024-01-27T13:57:48.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2533 0.14 MB/sec execute 571 sec latency 2773.452 ms 2024-01-27T13:57:49.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2542 0.14 MB/sec execute 572 sec latency 2698.747 ms 2024-01-27T13:57:50.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2544 0.14 MB/sec execute 573 sec latency 2483.584 ms 2024-01-27T13:57:51.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2545 0.14 MB/sec execute 574 sec latency 2448.399 ms 2024-01-27T13:57:52.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2548 0.14 MB/sec execute 575 sec latency 2516.485 ms 2024-01-27T13:57:53.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2553 0.14 MB/sec execute 576 sec latency 3112.412 ms 2024-01-27T13:57:54.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2559 0.14 MB/sec execute 577 sec latency 3137.156 ms 2024-01-27T13:57:55.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2560 0.14 MB/sec execute 578 sec latency 3543.708 ms 2024-01-27T13:57:56.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2562 0.14 MB/sec execute 579 sec latency 3201.766 ms 2024-01-27T13:57:57.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2564 0.14 MB/sec execute 580 sec latency 3567.504 ms 2024-01-27T13:57:58.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2566 0.13 MB/sec execute 581 sec latency 3239.120 ms 2024-01-27T13:57:59.546 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2569 0.13 MB/sec execute 582 sec latency 2878.729 ms 2024-01-27T13:58:00.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2573 0.13 MB/sec execute 583 sec latency 3223.226 ms 2024-01-27T13:58:01.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2577 0.13 MB/sec execute 584 sec latency 2930.114 ms 2024-01-27T13:58:02.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2578 0.13 MB/sec execute 585 sec latency 3195.303 ms 2024-01-27T13:58:03.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2579 0.13 MB/sec execute 586 sec latency 3798.513 ms 2024-01-27T13:58:03.990 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:58:03.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:58:04.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2580 0.13 MB/sec execute 587 sec latency 3761.811 ms 2024-01-27T13:58:05.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2581 0.13 MB/sec execute 588 sec latency 3744.451 ms 2024-01-27T13:58:06.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2583 0.13 MB/sec execute 589 sec latency 3080.805 ms 2024-01-27T13:58:07.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2585 0.13 MB/sec execute 590 sec latency 3226.254 ms 2024-01-27T13:58:08.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2587 0.13 MB/sec execute 591 sec latency 3434.137 ms 2024-01-27T13:58:09.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2591 0.13 MB/sec execute 592 sec latency 3172.450 ms 2024-01-27T13:58:10.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2593 0.13 MB/sec execute 593 sec latency 3100.331 ms 2024-01-27T13:58:11.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2596 0.13 MB/sec execute 594 sec latency 3436.272 ms 2024-01-27T13:58:12.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2598 0.13 MB/sec execute 595 sec latency 3515.932 ms 2024-01-27T13:58:13.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2599 0.13 MB/sec execute 596 sec latency 4186.803 ms 2024-01-27T13:58:14.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2600 0.13 MB/sec execute 597 sec latency 4249.910 ms 2024-01-27T13:58:15.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2611 0.14 MB/sec execute 598 sec latency 3439.196 ms 2024-01-27T13:58:16.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 2615 0.14 MB/sec execute 599 sec latency 2897.066 ms 2024-01-27T13:58:17.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 600 sec 2024-01-27T13:58:18.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 601 sec 2024-01-27T13:58:19.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 602 sec 2024-01-27T13:58:20.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 603 sec 2024-01-27T13:58:21.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 604 sec 2024-01-27T13:58:22.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 605 sec 2024-01-27T13:58:23.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 606 sec 2024-01-27T13:58:24.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 607 sec 2024-01-27T13:58:25.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 608 sec 2024-01-27T13:58:26.547 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 609 sec 2024-01-27T13:58:26.762 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:54.418 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.768 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:54.424 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.774 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:26:54.369 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.777 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:26:54.372 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.779 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:26:54.374 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.781 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:26:54.376 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.814 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:26:54.470 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.820 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:26:54.416 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:26.827 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:26:54.423 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T13:58:27.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 610 sec 2024-01-27T13:58:28.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 611 sec 2024-01-27T13:58:29.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 612 sec 2024-01-27T13:58:30.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 613 sec 2024-01-27T13:58:31.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 614 sec 2024-01-27T13:58:32.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 615 sec 2024-01-27T13:58:33.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 616 sec 2024-01-27T13:58:34.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:58:34.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:58:34.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 617 sec 2024-01-27T13:58:35.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 618 sec 2024-01-27T13:58:36.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 619 sec 2024-01-27T13:58:37.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 620 sec 2024-01-27T13:58:38.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 621 sec 2024-01-27T13:58:39.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 622 sec 2024-01-27T13:58:40.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 623 sec 2024-01-27T13:58:41.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 624 sec 2024-01-27T13:58:42.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 625 sec 2024-01-27T13:58:43.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 626 sec 2024-01-27T13:58:44.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 627 sec 2024-01-27T13:58:45.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 628 sec 2024-01-27T13:58:46.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 629 sec 2024-01-27T13:58:47.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 630 sec 2024-01-27T13:58:48.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 631 sec 2024-01-27T13:58:49.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 632 sec 2024-01-27T13:58:50.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 633 sec 2024-01-27T13:58:51.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 634 sec 2024-01-27T13:58:52.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 635 sec 2024-01-27T13:58:53.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 636 sec 2024-01-27T13:58:54.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 637 sec 2024-01-27T13:58:55.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 638 sec 2024-01-27T13:58:56.548 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 639 sec 2024-01-27T13:58:57.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 640 sec 2024-01-27T13:58:58.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 641 sec 2024-01-27T13:58:59.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 642 sec 2024-01-27T13:59:00.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 643 sec 2024-01-27T13:59:01.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 644 sec 2024-01-27T13:59:02.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 645 sec 2024-01-27T13:59:03.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 646 sec 2024-01-27T13:59:04.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:59:04.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:59:04.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 647 sec 2024-01-27T13:59:05.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 648 sec 2024-01-27T13:59:06.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 649 sec 2024-01-27T13:59:07.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 650 sec 2024-01-27T13:59:08.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 651 sec 2024-01-27T13:59:09.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 652 sec 2024-01-27T13:59:10.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 653 sec 2024-01-27T13:59:11.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 654 sec 2024-01-27T13:59:12.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 655 sec 2024-01-27T13:59:13.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 656 sec 2024-01-27T13:59:14.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 657 sec 2024-01-27T13:59:15.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 658 sec 2024-01-27T13:59:16.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 659 sec 2024-01-27T13:59:17.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 660 sec 2024-01-27T13:59:18.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 661 sec 2024-01-27T13:59:19.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 662 sec 2024-01-27T13:59:20.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 663 sec 2024-01-27T13:59:21.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 664 sec 2024-01-27T13:59:22.550 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 665 sec 2024-01-27T13:59:23.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 666 sec 2024-01-27T13:59:24.549 INFO:tasks.workunit.client.0.smithi046.stdout: 10 cleanup 667 sec 2024-01-27T13:59:25.549 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 668 sec 2024-01-27T13:59:26.549 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 669 sec 2024-01-27T13:59:27.551 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 670 sec 2024-01-27T13:59:28.550 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 671 sec 2024-01-27T13:59:29.550 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 672 sec 2024-01-27T13:59:30.550 INFO:tasks.workunit.client.0.smithi046.stdout: 9 cleanup 673 sec 2024-01-27T13:59:31.550 INFO:tasks.workunit.client.0.smithi046.stdout: 6 cleanup 674 sec 2024-01-27T13:59:32.550 INFO:tasks.workunit.client.0.smithi046.stdout: 4 cleanup 675 sec 2024-01-27T13:59:33.550 INFO:tasks.workunit.client.0.smithi046.stdout: 2 cleanup 676 sec 2024-01-27T13:59:33.818 INFO:tasks.workunit.client.0.smithi046.stdout: 0 cleanup 676 sec 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Operation Count AvgLat MaxLat 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: ---------------------------------------- 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: NTCreateX 3483 331.223 2348.667 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Close 2977 3.653 96.500 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Rename 169 994.890 2165.522 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Unlink 389 348.946 1116.671 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Qpathinfo 3450 219.674 2009.565 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Qfileinfo 649 7.128 55.472 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Qfsinfo 391 24.087 140.178 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Sfileinfo 478 43.589 192.102 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: Find 1147 3155.389 6646.489 2024-01-27T13:59:33.819 INFO:tasks.workunit.client.0.smithi046.stdout: WriteX 1994 15.238 601.748 2024-01-27T13:59:33.820 INFO:tasks.workunit.client.0.smithi046.stdout: ReadX 4171 0.131 28.869 2024-01-27T13:59:33.820 INFO:tasks.workunit.client.0.smithi046.stdout: Flush 334 313.218 995.408 2024-01-27T13:59:33.820 INFO:tasks.workunit.client.0.smithi046.stdout: 2024-01-27T13:59:33.820 INFO:tasks.workunit.client.0.smithi046.stdout:Throughput 0.137274 MB/sec 10 clients 10 procs max_latency=6646.496 ms 2024-01-27T13:59:33.820 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-27T13:59:33.820 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-27T13:59:34.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:59:34.401 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T13:59:56.619 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-01-27T13:59:56.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-27T13:59:56.905 DEBUG:teuthology.parallel:result is None 2024-01-27T13:59:56.905 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-27T13:59:57.113 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-27T13:59:57.113 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-01-27T13:59:57.124 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-01-27T13:59:57.124 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:59:57.124 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T13:59:57.139 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T13:59:57.139 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T13:59:57.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T13:59:57.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.350+0000 7f4a8c415640 1 Processor -- start 2024-01-27T13:59:57.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.350+0000 7f4a8c415640 1 -- start start 2024-01-27T13:59:57.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.351+0000 7f4a8c415640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a840c92e0 0x7f4a840cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.351+0000 7f4a8c415640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a840cb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.351+0000 7f4a8c415640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840ca9f0 con 0x7f4a840c8f00 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.351+0000 7f4a8c415640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a840cc9c0 con 0x7f4a840c92e0 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.351+0000 7f4a8c415640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84159d50 con 0x7f4a840cb3c0 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.352+0000 7f4a8a1b1640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4a840c8f00 0x7f4a840cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37228/0 (socket says 172.21.15.46:37228) 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.352+0000 7f4a8a1b1640 1 -- 172.21.15.46:0/1442756950 learned_addr learned my addr 172.21.15.46:0/1442756950 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:59:57.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.352+0000 7f4a899b0640 1 --2- 172.21.15.46:0/1442756950 >> v2:172.21.15.78:3300/0 conn(0x7f4a840c92e0 0x7f4a840cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:57.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.353+0000 7f4a8a9b2640 1 --2- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a840cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.354+0000 7f4a891af640 1 -- 172.21.15.46:0/1442756950 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226825352 0 0) 0x7f4a840ca9f0 con 0x7f4a840c8f00 2024-01-27T13:59:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.355+0000 7f4a891af640 1 -- 172.21.15.46:0/1442756950 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a6c003520 con 0x7f4a840c8f00 2024-01-27T13:59:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.355+0000 7f4a899b0640 1 -- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 msgr2=0x7f4a840cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:59:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.355+0000 7f4a899b0640 1 --2- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a840cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.355+0000 7f4a899b0640 1 -- 172.21.15.46:0/1442756950 >> v1:172.21.15.46:6789/0 conn(0x7f4a840c8f00 legacy=0x7f4a840cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.355+0000 7f4a899b0640 1 -- 172.21.15.46:0/1442756950 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840cc6e0 con 0x7f4a840c92e0 2024-01-27T13:59:57.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.357+0000 7f4a899b0640 1 --2- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a840cae80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a780097a0 tx=0x7f4a7802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a2b150a1c39d7a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:57.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a891af640 1 -- 172.21.15.46:0/1442756950 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78030610 con 0x7f4a840c92e0 2024-01-27T13:59:57.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a891af640 1 -- 172.21.15.46:0/1442756950 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78030770 con 0x7f4a840c92e0 2024-01-27T13:59:57.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a891af640 1 -- 172.21.15.46:0/1442756950 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78030b00 con 0x7f4a840c92e0 2024-01-27T13:59:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 -- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 msgr2=0x7f4a840cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a840cae80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a780097a0 tx=0x7f4a7802b960 comp rx=0 tx=0).stop 2024-01-27T13:59:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 -- 172.21.15.46:0/1442756950 shutdown_connections 2024-01-27T13:59:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a840cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1442756950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a840cae80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 -- 172.21.15.46:0/1442756950 >> 172.21.15.46:0/1442756950 conn(0x7f4a8408afd0 msgr2=0x7f4a8408b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 -- 172.21.15.46:0/1442756950 shutdown_connections 2024-01-27T13:59:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.361+0000 7f4a8c415640 1 -- 172.21.15.46:0/1442756950 wait complete. 2024-01-27T13:59:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 Processor -- start 2024-01-27T13:59:57.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 -- start start 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 0x7f4a840c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a84155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a84155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840c5090 con 0x7f4a840c8f00 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a841f0c00 con 0x7f4a840c92e0 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.363+0000 7f4a8c415640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840ab890 con 0x7f4a840cb3c0 2024-01-27T13:59:57.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.364+0000 7f4a8a1b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 0x7f4a840c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:57.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.364+0000 7f4a899b0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a84155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:57.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.364+0000 7f4a8a1b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 0x7f4a840c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53028/0 (socket says 172.21.15.46:53028) 2024-01-27T13:59:57.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.364+0000 7f4a8a1b1640 1 -- 172.21.15.46:0/1117210144 learned_addr learned my addr 172.21.15.46:0/1117210144 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:59:57.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.364+0000 7f4a8a9b2640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a84155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.368+0000 7f4a8a1b1640 1 -- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 msgr2=0x7f4a84155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.368+0000 7f4a8a1b1640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a84155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.368+0000 7f4a8a1b1640 1 -- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 msgr2=0x7f4a84155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.368+0000 7f4a8a1b1640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a84155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.368+0000 7f4a8a1b1640 1 -- 172.21.15.46:0/1117210144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a78009400 con 0x7f4a840c8f00 2024-01-27T13:59:57.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.370+0000 7f4a8a1b1640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 0x7f4a840c4500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c430 tx=0x7f4a7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.374+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c005ce0 con 0x7f4a840c8f00 2024-01-27T13:59:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.374+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7c005e40 con 0x7f4a840c8f00 2024-01-27T13:59:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.374+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a840c4b50 con 0x7f4a840c8f00 2024-01-27T13:59:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.374+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0072f0 con 0x7f4a840c8f00 2024-01-27T13:59:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.374+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a841f05b0 con 0x7f4a840c8f00 2024-01-27T13:59:57.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.375+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a841f0410 con 0x7f4a840c8f00 2024-01-27T13:59:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.641+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4a7c007450 con 0x7f4a840c8f00 2024-01-27T13:59:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.641+0000 7f4a82ffd640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4a7006af00 0x7f4a7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.641+0000 7f4a899b0640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4a7006af00 0x7f4a7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.642+0000 7f4a899b0640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4a7006af00 0x7f4a7006d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a78036000 tx=0x7f4a78008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:57.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.670+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a7c057b30 con 0x7f4a840c8f00 2024-01-27T13:59:57.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.670+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4a7c053e70 con 0x7f4a840c8f00 2024-01-27T13:59:57.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.852+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a841f0410 con 0x7f4a840c8f00 2024-01-27T13:59:57.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.894+0000 7f4a82ffd640 1 -- 172.21.15.46:0/1117210144 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f4a841f0410 con 0x7f4a840c8f00 2024-01-27T13:59:57.882 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T13:59:57.882 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4a7006af00 msgr2=0x7f4a7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4a7006af00 0x7f4a7006d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a78036000 tx=0x7f4a78008030 comp rx=0 tx=0).stop 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 msgr2=0x7f4a840c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 0x7f4a840c4500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00c430 tx=0x7f4a7c00c8f0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 shutdown_connections 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4a7006af00 0x7f4a7006d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4a840cb3c0 0x7f4a84155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a840c92e0 0x7f4a84155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 --2- 172.21.15.46:0/1117210144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a840c8f00 0x7f4a840c4500 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 >> 172.21.15.46:0/1117210144 conn(0x7f4a8408afd0 msgr2=0x7f4a840cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 shutdown_connections 2024-01-27T13:59:57.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:57.897+0000 7f4a8c415640 1 -- 172.21.15.46:0/1117210144 wait complete. 2024-01-27T13:59:57.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T13:32:10.212389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T13:32:11.933652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T13:32:15.934129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T13:59:57.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T13:59:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.026+0000 7f7ae6d3a640 1 Processor -- start 2024-01-27T13:59:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.026+0000 7f7ae6d3a640 1 -- start start 2024-01-27T13:59:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.027+0000 7f7ae6d3a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7ae0153b80 0x7f7ae01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.027+0000 7f7ae6d3a640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7ae00c99d0 0x7f7ae00c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.027+0000 7f7ae6d3a640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00c7620 con 0x7f7ae00c8010 2024-01-27T13:59:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.027+0000 7f7ae6d3a640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00c67b0 con 0x7f7ae00c99d0 2024-01-27T13:59:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.027+0000 7f7ae6d3a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00ca180 con 0x7f7ae0153b80 2024-01-27T13:59:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.028+0000 7f7adffff640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7ae00c99d0 0x7f7ae00c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.028+0000 7f7ae52d7640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7ae00c8010 0x7f7ae006ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37230/0 (socket says 172.21.15.46:37230) 2024-01-27T13:59:58.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.028+0000 7f7ae52d7640 1 -- 172.21.15.46:0/2755052315 learned_addr learned my addr 172.21.15.46:0/2755052315 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:59:58.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.029+0000 7f7ae4ad6640 1 --2- 172.21.15.46:0/2755052315 >> v2:172.21.15.78:3300/0 conn(0x7f7ae0153b80 0x7f7ae01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.031+0000 7f7adffff640 1 -- 172.21.15.46:0/2755052315 >> v2:172.21.15.78:3300/0 conn(0x7f7ae0153b80 msgr2=0x7f7ae01598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:59:58.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.031+0000 7f7adffff640 1 --2- 172.21.15.46:0/2755052315 >> v2:172.21.15.78:3300/0 conn(0x7f7ae0153b80 0x7f7ae01598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.031+0000 7f7adffff640 1 -- 172.21.15.46:0/2755052315 >> v1:172.21.15.46:6789/0 conn(0x7f7ae00c8010 legacy=0x7f7ae006ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.031+0000 7f7adffff640 1 -- 172.21.15.46:0/2755052315 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00ca460 con 0x7f7ae00c99d0 2024-01-27T13:59:58.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.036+0000 7f7adffff640 1 --2- 172.21.15.46:0/2755052315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae00c99d0 0x7f7ae00c7ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0062450 tx=0x7f7ad002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c62c0649d32610 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:58.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.039+0000 7f7adf7fe640 1 -- 172.21.15.46:0/2755052315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad002e070 con 0x7f7ae00c99d0 2024-01-27T13:59:58.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.039+0000 7f7adf7fe640 1 -- 172.21.15.46:0/2755052315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad00315a0 con 0x7f7ae00c99d0 2024-01-27T13:59:58.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.039+0000 7f7adf7fe640 1 -- 172.21.15.46:0/2755052315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0031930 con 0x7f7ae00c99d0 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/2755052315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae00c99d0 msgr2=0x7f7ae00c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/2755052315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae00c99d0 0x7f7ae00c7ad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0062450 tx=0x7f7ad002b840 comp rx=0 tx=0).stop 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/2755052315 shutdown_connections 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/2755052315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae00c99d0 0x7f7ae00c7ad0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/2755052315 >> v2:172.21.15.78:3300/0 conn(0x7f7ae0153b80 0x7f7ae01598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/2755052315 >> 172.21.15.46:0/2755052315 conn(0x7f7ae00cf230 msgr2=0x7f7ae00cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/2755052315 shutdown_connections 2024-01-27T13:59:58.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.040+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/2755052315 wait complete. 2024-01-27T13:59:58.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.041+0000 7f7ae6d3a640 1 Processor -- start 2024-01-27T13:59:58.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 -- start start 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae00c8010 0x7f7ae0154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ae00c99d0 0x7f7ae01e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 0x7f7ae01e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01ef040 con 0x7f7ae0153b80 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01f0010 con 0x7f7ae00c8010 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.042+0000 7f7ae6d3a640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01efb80 con 0x7f7ae00c99d0 2024-01-27T13:59:58.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.043+0000 7f7ae52d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 0x7f7ae01e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.043+0000 7f7ae52d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 0x7f7ae01e3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53034/0 (socket says 172.21.15.46:53034) 2024-01-27T13:59:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.043+0000 7f7ae52d7640 1 -- 172.21.15.46:0/3925790442 learned_addr learned my addr 172.21.15.46:0/3925790442 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:59:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.043+0000 7f7ae4ad6640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae00c8010 0x7f7ae0154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.043+0000 7f7adffff640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ae00c99d0 0x7f7ae01e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.047+0000 7f7ae52d7640 1 -- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ae00c99d0 msgr2=0x7f7ae01e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.047+0000 7f7ae52d7640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ae00c99d0 0x7f7ae01e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.047+0000 7f7ae52d7640 1 -- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae00c8010 msgr2=0x7f7ae0154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.047+0000 7f7ae52d7640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae00c8010 0x7f7ae0154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.047+0000 7f7ae52d7640 1 -- 172.21.15.46:0/3925790442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0009400 con 0x7f7ae0153b80 2024-01-27T13:59:58.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.049+0000 7f7ae52d7640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 0x7f7ae01e3ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800cbf0 tx=0x7f7ad800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:58.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.051+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800ad40 con 0x7f7ae0153b80 2024-01-27T13:59:58.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.051+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae0154870 con 0x7f7ae0153b80 2024-01-27T13:59:58.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.051+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae01ef530 con 0x7f7ae0153b80 2024-01-27T13:59:58.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.052+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0067ca0 con 0x7f7ae0153b80 2024-01-27T13:59:58.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.262+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8001c00 con 0x7f7ae0153b80 2024-01-27T13:59:58.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.303+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800aea0 con 0x7f7ae0153b80 2024-01-27T13:59:58.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.316+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7ad8007070 con 0x7f7ae0153b80 2024-01-27T13:59:58.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.316+0000 7f7add7fa640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7ac006aed0 0x7f7ac006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.316+0000 7f7ae4ad6640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7ac006aed0 0x7f7ac006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.317+0000 7f7ae4ad6640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7ac006aed0 0x7f7ac006d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80079a0 tx=0x7f7ac8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.330+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ad8058620 con 0x7f7ae0153b80 2024-01-27T13:59:58.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.330+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7ad8054960 con 0x7f7ae0153b80 2024-01-27T13:59:58.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.516+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ae0074410 con 0x7f7ae0153b80 2024-01-27T13:59:58.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.521+0000 7f7add7fa640 1 -- 172.21.15.46:0/3925790442 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ad80170a0 con 0x7f7ae0153b80 2024-01-27T13:59:58.508 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T13:59:58.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.523+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7ac006aed0 msgr2=0x7f7ac006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.523+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7ac006aed0 0x7f7ac006d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80079a0 tx=0x7f7ac8008040 comp rx=0 tx=0).stop 2024-01-27T13:59:58.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.523+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 msgr2=0x7f7ae01e3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.523+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 0x7f7ae01e3ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800cbf0 tx=0x7f7ad800a430 comp rx=0 tx=0).stop 2024-01-27T13:59:58.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 shutdown_connections 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7ac006aed0 0x7f7ac006d390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ae0153b80 0x7f7ae01e3ea0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7ae00c99d0 0x7f7ae01e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 --2- 172.21.15.46:0/3925790442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae00c8010 0x7f7ae0154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 >> 172.21.15.46:0/3925790442 conn(0x7f7ae00cf230 msgr2=0x7f7ae01e5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 shutdown_connections 2024-01-27T13:59:58.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.524+0000 7f7ae6d3a640 1 -- 172.21.15.46:0/3925790442 wait complete. 2024-01-27T13:59:58.523 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T13:59:58.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.644+0000 7fde8c78e640 1 Processor -- start 2024-01-27T13:59:58.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.644+0000 7fde8c78e640 1 -- start start 2024-01-27T13:59:58.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.645+0000 7fde8c78e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde840c28c0 0x7fde840c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.645+0000 7fde8c78e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde84151c00 0x7fde84157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.645+0000 7fde8c78e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde840ccf60 con 0x7fde840c2ca0 2024-01-27T13:59:58.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.645+0000 7fde8c78e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840ca800 con 0x7fde84151c00 2024-01-27T13:59:58.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.645+0000 7fde8c78e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde841576d0 con 0x7fde840c28c0 2024-01-27T13:59:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.646+0000 7fde8a52a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde840c28c0 0x7fde840c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.646+0000 7fde8ad2b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fde84151c00 0x7fde84157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.646+0000 7fde89d29640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fde840c2ca0 0x7fde841514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37246/0 (socket says 172.21.15.46:37246) 2024-01-27T13:59:58.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.646+0000 7fde89d29640 1 -- 172.21.15.46:0/2620544809 learned_addr learned my addr 172.21.15.46:0/2620544809 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:59:58.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.649+0000 7fde8a52a640 1 -- 172.21.15.46:0/2620544809 >> v2:172.21.15.46:3300/0 conn(0x7fde84151c00 msgr2=0x7fde84157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:59:58.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.649+0000 7fde8a52a640 1 --2- 172.21.15.46:0/2620544809 >> v2:172.21.15.46:3300/0 conn(0x7fde84151c00 0x7fde84157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.649+0000 7fde8a52a640 1 -- 172.21.15.46:0/2620544809 >> v1:172.21.15.46:6789/0 conn(0x7fde840c2ca0 legacy=0x7fde841514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.649+0000 7fde8a52a640 1 -- 172.21.15.46:0/2620544809 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840cd200 con 0x7fde840c28c0 2024-01-27T13:59:58.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.651+0000 7fde8a52a640 1 --2- 172.21.15.46:0/2620544809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde840c28c0 0x7fde840c1cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde840718d0 tx=0x7fde8002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1bda1c2cabb94d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:58.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.654+0000 7fde89528640 1 -- 172.21.15.46:0/2620544809 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031830 con 0x7fde840c28c0 2024-01-27T13:59:58.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde89528640 1 -- 172.21.15.46:0/2620544809 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80031990 con 0x7fde840c28c0 2024-01-27T13:59:58.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde89528640 1 -- 172.21.15.46:0/2620544809 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031d20 con 0x7fde840c28c0 2024-01-27T13:59:58.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde8c78e640 1 -- 172.21.15.46:0/2620544809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde840c28c0 msgr2=0x7fde840c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde8c78e640 1 --2- 172.21.15.46:0/2620544809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde840c28c0 0x7fde840c1cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde840718d0 tx=0x7fde8002b8d0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde8c78e640 1 -- 172.21.15.46:0/2620544809 shutdown_connections 2024-01-27T13:59:58.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde8c78e640 1 --2- 172.21.15.46:0/2620544809 >> v2:172.21.15.46:3300/0 conn(0x7fde84151c00 0x7fde84157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde8c78e640 1 --2- 172.21.15.46:0/2620544809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde840c28c0 0x7fde840c1cd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.655+0000 7fde8c78e640 1 -- 172.21.15.46:0/2620544809 >> 172.21.15.46:0/2620544809 conn(0x7fde8406efe0 msgr2=0x7fde8406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:58.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.656+0000 7fde8c78e640 1 -- 172.21.15.46:0/2620544809 shutdown_connections 2024-01-27T13:59:58.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.656+0000 7fde8c78e640 1 -- 172.21.15.46:0/2620544809 wait complete. 2024-01-27T13:59:58.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.657+0000 7fde8c78e640 1 Processor -- start 2024-01-27T13:59:58.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.657+0000 7fde8c78e640 1 -- start start 2024-01-27T13:59:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.658+0000 7fde8c78e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c28c0 0x7fde8414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.658+0000 7fde8c78e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde840c2ca0 0x7fde841523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.658+0000 7fde8c78e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde84151c00 0x7fde84152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.658+0000 7fde8c78e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b2250 con 0x7fde840c28c0 2024-01-27T13:59:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.658+0000 7fde8c78e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b1cf0 con 0x7fde84151c00 2024-01-27T13:59:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.658+0000 7fde8c78e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde841de920 con 0x7fde840c2ca0 2024-01-27T13:59:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.659+0000 7fde8ad2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde84151c00 0x7fde84152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.659+0000 7fde8a52a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c28c0 0x7fde8414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.659+0000 7fde89d29640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde840c2ca0 0x7fde841523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.659+0000 7fde8a52a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c28c0 0x7fde8414fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53046/0 (socket says 172.21.15.46:53046) 2024-01-27T13:59:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.659+0000 7fde8a52a640 1 -- 172.21.15.46:0/996756354 learned_addr learned my addr 172.21.15.46:0/996756354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:59:58.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.663+0000 7fde8ad2b640 1 -- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde840c2ca0 msgr2=0x7fde841523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.663+0000 7fde8ad2b640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde840c2ca0 0x7fde841523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.663+0000 7fde8ad2b640 1 -- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c28c0 msgr2=0x7fde8414fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.663+0000 7fde8ad2b640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c28c0 0x7fde8414fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.663+0000 7fde8ad2b640 1 -- 172.21.15.46:0/996756354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde80009400 con 0x7fde84151c00 2024-01-27T13:59:58.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.665+0000 7fde8ad2b640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde84151c00 0x7fde84152900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00eba0 tx=0x7fde7c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.668+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00cd20 con 0x7fde84151c00 2024-01-27T13:59:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.668+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00f040 con 0x7fde84151c00 2024-01-27T13:59:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.669+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0146c0 con 0x7fde84151c00 2024-01-27T13:59:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.669+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840b1f70 con 0x7fde84151c00 2024-01-27T13:59:58.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.669+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde841de640 con 0x7fde84151c00 2024-01-27T13:59:58.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.670+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde841520e0 con 0x7fde84151c00 2024-01-27T13:59:58.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.688+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fde7c014820 con 0x7fde84151c00 2024-01-27T13:59:58.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.689+0000 7fde76ffd640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fde6806af20 0x7fde6806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:58.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.689+0000 7fde8a52a640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fde6806af20 0x7fde6806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:58.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.690+0000 7fde8a52a640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fde6806af20 0x7fde6806d3e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde8002b910 tx=0x7fde8003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:58.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.691+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fde7c00ce80 con 0x7fde84151c00 2024-01-27T13:59:58.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:58.928+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fde7c055590 con 0x7fde84151c00 2024-01-27T13:59:59.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.109+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde841520a0 con 0x7fde84151c00 2024-01-27T13:59:59.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.114+0000 7fde76ffd640 1 -- 172.21.15.46:0/996756354 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde7c0180a0 con 0x7fde84151c00 2024-01-27T13:59:59.101 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fde6806af20 msgr2=0x7fde6806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fde6806af20 0x7fde6806d3e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde8002b910 tx=0x7fde8003c040 comp rx=0 tx=0).stop 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde84151c00 msgr2=0x7fde84152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde84151c00 0x7fde84152900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00eba0 tx=0x7fde7c00c490 comp rx=0 tx=0).stop 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 shutdown_connections 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fde6806af20 0x7fde6806d3e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde84151c00 0x7fde84152900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fde840c2ca0 0x7fde841523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 --2- 172.21.15.46:0/996756354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde840c28c0 0x7fde8414fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 >> 172.21.15.46:0/996756354 conn(0x7fde8406efe0 msgr2=0x7fde840663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 shutdown_connections 2024-01-27T13:59:59.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.116+0000 7fde8c78e640 1 -- 172.21.15.46:0/996756354 wait complete. 2024-01-27T13:59:59.115 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T13:59:59.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.233+0000 7f7dd9325640 1 Processor -- start 2024-01-27T13:59:59.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.233+0000 7f7dd9325640 1 -- start start 2024-01-27T13:59:59.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.234+0000 7f7dd9325640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd4153ca0 0x7f7dd40c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.234+0000 7f7dd9325640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7dd40c5b00 0x7f7dd40c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.234+0000 7f7dd9325640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd415a280 con 0x7f7dd40c4750 2024-01-27T13:59:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.234+0000 7f7dd9325640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40c5f70 con 0x7f7dd4153ca0 2024-01-27T13:59:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.234+0000 7f7dd9325640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40c6750 con 0x7f7dd40c5b00 2024-01-27T13:59:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.235+0000 7f7dd37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7dd40c5b00 0x7f7dd40c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.235+0000 7f7dd2ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7dd4153ca0 0x7f7dd40c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.235+0000 7f7dd27fc640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f7dd40c4750 0x7f7dd406bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37256/0 (socket says 172.21.15.46:37256) 2024-01-27T13:59:59.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.235+0000 7f7dd27fc640 1 -- 172.21.15.46:0/143218242 learned_addr learned my addr 172.21.15.46:0/143218242 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:59:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.238+0000 7f7dd37fe640 1 -- 172.21.15.46:0/143218242 >> v2:172.21.15.46:3300/0 conn(0x7f7dd4153ca0 msgr2=0x7f7dd40c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T13:59:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.238+0000 7f7dd37fe640 1 --2- 172.21.15.46:0/143218242 >> v2:172.21.15.46:3300/0 conn(0x7f7dd4153ca0 0x7f7dd40c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.238+0000 7f7dd37fe640 1 -- 172.21.15.46:0/143218242 >> v1:172.21.15.46:6789/0 conn(0x7f7dd40c4750 legacy=0x7f7dd406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.238+0000 7f7dd37fe640 1 -- 172.21.15.46:0/143218242 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd415a790 con 0x7f7dd40c5b00 2024-01-27T13:59:59.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.239+0000 7f7dd37fe640 1 --2- 172.21.15.46:0/143218242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5b00 0x7f7dd40c99d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7dd408b060 tx=0x7f7dc402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d19606505ab4459 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:59.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.243+0000 7f7dd1ffb640 1 -- 172.21.15.46:0/143218242 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc402cd00 con 0x7f7dd40c5b00 2024-01-27T13:59:59.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.243+0000 7f7dd1ffb640 1 -- 172.21.15.46:0/143218242 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc402ce60 con 0x7f7dd40c5b00 2024-01-27T13:59:59.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.243+0000 7f7dd1ffb640 1 -- 172.21.15.46:0/143218242 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4034660 con 0x7f7dd40c5b00 2024-01-27T13:59:59.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 -- 172.21.15.46:0/143218242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5b00 msgr2=0x7f7dd40c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 --2- 172.21.15.46:0/143218242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5b00 0x7f7dd40c99d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7dd408b060 tx=0x7f7dc402bf50 comp rx=0 tx=0).stop 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 -- 172.21.15.46:0/143218242 shutdown_connections 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 --2- 172.21.15.46:0/143218242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c5b00 0x7f7dd40c99d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 --2- 172.21.15.46:0/143218242 >> v2:172.21.15.46:3300/0 conn(0x7f7dd4153ca0 0x7f7dd40c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 -- 172.21.15.46:0/143218242 >> 172.21.15.46:0/143218242 conn(0x7f7dd40cf230 msgr2=0x7f7dd40cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 -- 172.21.15.46:0/143218242 shutdown_connections 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.244+0000 7f7dd9325640 1 -- 172.21.15.46:0/143218242 wait complete. 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.245+0000 7f7dd9325640 1 Processor -- start 2024-01-27T13:59:59.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.245+0000 7f7dd9325640 1 -- start start 2024-01-27T13:59:59.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd9325640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c4750 0x7f7dd41ef690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd9325640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd40c5b00 0x7f7dd414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd9325640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 0x7f7dd40c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd9325640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd41f33d0 con 0x7f7dd4153ca0 2024-01-27T13:59:59.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd9325640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414dbc0 con 0x7f7dd40c4750 2024-01-27T13:59:59.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd9325640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd414dea0 con 0x7f7dd40c5b00 2024-01-27T13:59:59.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.246+0000 7f7dd37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 0x7f7dd40c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.247+0000 7f7dd2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c4750 0x7f7dd41ef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.247+0000 7f7dd37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 0x7f7dd40c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53068/0 (socket says 172.21.15.46:53068) 2024-01-27T13:59:59.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.247+0000 7f7dd37fe640 1 -- 172.21.15.46:0/289933751 learned_addr learned my addr 172.21.15.46:0/289933751 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:59:59.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.247+0000 7f7dd27fc640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd40c5b00 0x7f7dd414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.250+0000 7f7dd37fe640 1 -- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd40c5b00 msgr2=0x7f7dd414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.250+0000 7f7dd37fe640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd40c5b00 0x7f7dd414cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.250+0000 7f7dd37fe640 1 -- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c4750 msgr2=0x7f7dd41ef690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.250+0000 7f7dd37fe640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c4750 0x7f7dd41ef690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.250+0000 7f7dd37fe640 1 -- 172.21.15.46:0/289933751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc4009a70 con 0x7f7dd4153ca0 2024-01-27T13:59:59.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.253+0000 7f7dd37fe640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 0x7f7dd40c7870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009e80 tx=0x7f7dc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.256+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc403d600 con 0x7f7dd4153ca0 2024-01-27T13:59:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.256+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc403d780 con 0x7f7dd4153ca0 2024-01-27T13:59:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.256+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc403db30 con 0x7f7dd4153ca0 2024-01-27T13:59:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.256+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd41f2d80 con 0x7f7dd4153ca0 2024-01-27T13:59:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.256+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd41efbd0 con 0x7f7dd4153ca0 2024-01-27T13:59:59.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.257+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd41f3540 con 0x7f7dd4153ca0 2024-01-27T13:59:59.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.276+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7dc403b040 con 0x7f7dd4153ca0 2024-01-27T13:59:59.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.276+0000 7f7dcb7fe640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7db406af20 0x7f7db406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.277+0000 7f7dd2ffd640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7db406af20 0x7f7db406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.277+0000 7f7dd2ffd640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7db406af20 0x7f7db406d3e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009b40 tx=0x7f7dcc009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:59.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.534+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7dc407abf0 con 0x7f7dd4153ca0 2024-01-27T13:59:59.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.534+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7dc4076f70 con 0x7f7dd4153ca0 2024-01-27T13:59:59.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.734+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7dd4074410 con 0x7f7dd4153ca0 2024-01-27T13:59:59.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.740+0000 7f7dcb7fe640 1 -- 172.21.15.46:0/289933751 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7dc404e020 con 0x7f7dd4153ca0 2024-01-27T13:59:59.726 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7db406af20 msgr2=0x7f7db406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7db406af20 0x7f7db406d3e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009b40 tx=0x7f7dcc009190 comp rx=0 tx=0).stop 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 msgr2=0x7f7dd40c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 0x7f7dd40c7870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009e80 tx=0x7f7dc4004a40 comp rx=0 tx=0).stop 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 shutdown_connections 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7db406af20 0x7f7db406d3e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7dd4153ca0 0x7f7dd40c7870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7dd40c5b00 0x7f7dd414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 --2- 172.21.15.46:0/289933751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dd40c4750 0x7f7dd41ef690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 >> 172.21.15.46:0/289933751 conn(0x7f7dd40cf230 msgr2=0x7f7dd40ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 shutdown_connections 2024-01-27T13:59:59.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.742+0000 7f7dd9325640 1 -- 172.21.15.46:0/289933751 wait complete. 2024-01-27T13:59:59.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T13:59:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.857+0000 7f2e0edce640 1 Processor -- start 2024-01-27T13:59:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.857+0000 7f2e0edce640 1 -- start start 2024-01-27T13:59:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.858+0000 7f2e0edce640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2e080c81e0 0x7f2e0806ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.858+0000 7f2e0edce640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e080c7620 con 0x7f2e08153b80 2024-01-27T13:59:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.858+0000 7f2e0edce640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e080ca180 con 0x7f2e081598e0 2024-01-27T13:59:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.858+0000 7f2e0edce640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e080c67b0 con 0x7f2e080c81e0 2024-01-27T13:59:59.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.859+0000 7f2e0cb6a640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f2e08153b80 0x7f2e080c99d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37262/0 (socket says 172.21.15.46:37262) 2024-01-27T13:59:59.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.859+0000 7f2e0cb6a640 1 -- 172.21.15.46:0/529186016 learned_addr learned my addr 172.21.15.46:0/529186016 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T13:59:59.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.859+0000 7f2e0d36b640 1 --2- 172.21.15.46:0/529186016 >> v2:172.21.15.78:3300/0 conn(0x7f2e080c81e0 0x7f2e0806ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.861+0000 7f2e077fe640 1 -- 172.21.15.46:0/529186016 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067408357 0 0) 0x7f2e080c7620 con 0x7f2e08153b80 2024-01-27T13:59:59.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.861+0000 7f2e077fe640 1 -- 172.21.15.46:0/529186016 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df4003520 con 0x7f2e08153b80 2024-01-27T13:59:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.862+0000 7f2e0d36b640 1 -- 172.21.15.46:0/529186016 >> v1:172.21.15.78:6789/0 conn(0x7f2e081598e0 legacy=0x7f2e080c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.862+0000 7f2e0d36b640 1 -- 172.21.15.46:0/529186016 >> v1:172.21.15.46:6789/0 conn(0x7f2e08153b80 legacy=0x7f2e080c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.862+0000 7f2e0d36b640 1 -- 172.21.15.46:0/529186016 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080ca460 con 0x7f2e080c81e0 2024-01-27T13:59:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.866+0000 7f2e0d36b640 1 --2- 172.21.15.46:0/529186016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e0806ba60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2df00097a0 tx=0x7f2df002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b140613fae625ddc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:59.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.869+0000 7f2e077fe640 1 -- 172.21.15.46:0/529186016 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0031830 con 0x7f2e080c81e0 2024-01-27T13:59:59.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.869+0000 7f2e077fe640 1 -- 172.21.15.46:0/529186016 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df0031990 con 0x7f2e080c81e0 2024-01-27T13:59:59.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.869+0000 7f2e077fe640 1 -- 172.21.15.46:0/529186016 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df0031d20 con 0x7f2e080c81e0 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 -- 172.21.15.46:0/529186016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 msgr2=0x7f2e0806ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 --2- 172.21.15.46:0/529186016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e0806ba60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2df00097a0 tx=0x7f2df002b8d0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 -- 172.21.15.46:0/529186016 shutdown_connections 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 --2- 172.21.15.46:0/529186016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e0806ba60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 -- 172.21.15.46:0/529186016 >> 172.21.15.46:0/529186016 conn(0x7f2e080cf230 msgr2=0x7f2e080cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 -- 172.21.15.46:0/529186016 shutdown_connections 2024-01-27T13:59:59.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.870+0000 7f2e0edce640 1 -- 172.21.15.46:0/529186016 wait complete. 2024-01-27T13:59:59.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.871+0000 7f2e0edce640 1 Processor -- start 2024-01-27T13:59:59.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.871+0000 7f2e0edce640 1 -- start start 2024-01-27T13:59:59.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.872+0000 7f2e0edce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e08149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.872+0000 7f2e0edce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 0x7f2e0814b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.872+0000 7f2e0edce640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e081598e0 0x7f2e0814b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T13:59:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.872+0000 7f2e0edce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e080c57a0 con 0x7f2e08153b80 2024-01-27T13:59:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.872+0000 7f2e0edce640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e081f31a0 con 0x7f2e080c81e0 2024-01-27T13:59:59.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.872+0000 7f2e0edce640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0814cff0 con 0x7f2e081598e0 2024-01-27T13:59:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.873+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 0x7f2e0814b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.873+0000 7f2e0d36b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e081598e0 0x7f2e0814b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.873+0000 7f2e0cb6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e08149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T13:59:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.873+0000 7f2e07fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 0x7f2e0814b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53070/0 (socket says 172.21.15.46:53070) 2024-01-27T13:59:59.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.873+0000 7f2e07fff640 1 -- 172.21.15.46:0/784219563 learned_addr learned my addr 172.21.15.46:0/784219563 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T13:59:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.876+0000 7f2e07fff640 1 -- 172.21.15.46:0/784219563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e081598e0 msgr2=0x7f2e0814b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.876+0000 7f2e07fff640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e081598e0 0x7f2e0814b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.876+0000 7f2e07fff640 1 -- 172.21.15.46:0/784219563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 msgr2=0x7f2e08149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T13:59:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.876+0000 7f2e07fff640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e08149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T13:59:59.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.876+0000 7f2e07fff640 1 -- 172.21.15.46:0/784219563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0009400 con 0x7f2e08153b80 2024-01-27T13:59:59.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.879+0000 7f2e07fff640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 0x7f2e0814b2b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c3c0 tx=0x7f2df800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T13:59:59.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.883+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80052d0 con 0x7f2e08153b80 2024-01-27T13:59:59.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.883+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8005450 con 0x7f2e08153b80 2024-01-27T13:59:59.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.883+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8007260 con 0x7f2e08153b80 2024-01-27T13:59:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.883+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0814d2d0 con 0x7f2e08153b80 2024-01-27T13:59:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.883+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e080cb070 con 0x7f2e08153b80 2024-01-27T13:59:59.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T13:59:59.884+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e08067ca0 con 0x7f2e08153b80 2024-01-27T14:00:00.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.146+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2df80073c0 con 0x7f2e08153b80 2024-01-27T14:00:00.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.146+0000 7f2e057fa640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2de806af20 0x7f2de806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.146+0000 7f2e0cb6a640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2de806af20 0x7f2de806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.147+0000 7f2e0cb6a640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2de806af20 0x7f2de806d3e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e00001560 tx=0x7f2e00001a90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.162+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2df8057a60 con 0x7f2e08153b80 2024-01-27T14:00:00.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.162+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2df8053da0 con 0x7f2e08153b80 2024-01-27T14:00:00.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.340+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2e080c65d0 con 0x7f2e08153b80 2024-01-27T14:00:00.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.345+0000 7f2e057fa640 1 -- 172.21.15.46:0/784219563 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2df8020020 con 0x7f2e08153b80 2024-01-27T14:00:00.332 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:00:00.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2de806af20 msgr2=0x7f2de806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2de806af20 0x7f2de806d3e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e00001560 tx=0x7f2e00001a90 comp rx=0 tx=0).stop 2024-01-27T14:00:00.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 msgr2=0x7f2e0814b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 0x7f2e0814b2b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c3c0 tx=0x7f2df800c880 comp rx=0 tx=0).stop 2024-01-27T14:00:00.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 shutdown_connections 2024-01-27T14:00:00.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f2de806af20 0x7f2de806d3e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f2e081598e0 0x7f2e0814b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e08153b80 0x7f2e0814b2b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 --2- 172.21.15.46:0/784219563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e080c81e0 0x7f2e08149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 >> 172.21.15.46:0/784219563 conn(0x7f2e080cf230 msgr2=0x7f2e08158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 shutdown_connections 2024-01-27T14:00:00.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.347+0000 7f2e0edce640 1 -- 172.21.15.46:0/784219563 wait complete. 2024-01-27T14:00:00.346 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T14:00:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.463+0000 7f318340e640 1 Processor -- start 2024-01-27T14:00:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.463+0000 7f318340e640 1 -- start start 2024-01-27T14:00:00.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.464+0000 7f318340e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f317c151aa0 0x7f317c0725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.464+0000 7f318340e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c15ae40 0x7f317c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.464+0000 7f318340e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c15b7f0 con 0x7f317c071140 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.464+0000 7f318340e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0c2420 con 0x7f317c151aa0 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.464+0000 7f318340e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c158520 con 0x7f317c15ae40 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.465+0000 7f31811aa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f317c151aa0 0x7f317c0725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.465+0000 7f31811aa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f317c151aa0 0x7f317c0725f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53074/0 (socket says 172.21.15.46:53074) 2024-01-27T14:00:00.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.465+0000 7f31811aa640 1 -- 172.21.15.46:0/2087869518 learned_addr learned my addr 172.21.15.46:0/2087869518 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:00.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.465+0000 7f31819ab640 1 --2- 172.21.15.46:0/2087869518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c15ae40 0x7f317c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.467+0000 7f31811aa640 1 -- 172.21.15.46:0/2087869518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c15ae40 msgr2=0x7f317c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:00.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.467+0000 7f31811aa640 1 --2- 172.21.15.46:0/2087869518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c15ae40 0x7f317c15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.467+0000 7f31811aa640 1 -- 172.21.15.46:0/2087869518 >> v1:172.21.15.78:6789/0 conn(0x7f317c071140 legacy=0x7f317c071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.467+0000 7f31811aa640 1 -- 172.21.15.46:0/2087869518 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c157630 con 0x7f317c151aa0 2024-01-27T14:00:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.469+0000 7f31811aa640 1 --2- 172.21.15.46:0/2087869518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c151aa0 0x7f317c0725f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3174009870 tx=0x7f317402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fff463b60bd2f5c server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.471+0000 7f317bfff640 1 -- 172.21.15.46:0/2087869518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174030840 con 0x7f317c151aa0 2024-01-27T14:00:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.473+0000 7f317bfff640 1 -- 172.21.15.46:0/2087869518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31740309a0 con 0x7f317c151aa0 2024-01-27T14:00:00.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.473+0000 7f317bfff640 1 -- 172.21.15.46:0/2087869518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174030d30 con 0x7f317c151aa0 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 -- 172.21.15.46:0/2087869518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c151aa0 msgr2=0x7f317c0725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 --2- 172.21.15.46:0/2087869518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c151aa0 0x7f317c0725f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3174009870 tx=0x7f317402b980 comp rx=0 tx=0).stop 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 -- 172.21.15.46:0/2087869518 shutdown_connections 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 --2- 172.21.15.46:0/2087869518 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c15ae40 0x7f317c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 --2- 172.21.15.46:0/2087869518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c151aa0 0x7f317c0725f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 -- 172.21.15.46:0/2087869518 >> 172.21.15.46:0/2087869518 conn(0x7f317c0cae90 msgr2=0x7f317c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 -- 172.21.15.46:0/2087869518 shutdown_connections 2024-01-27T14:00:00.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.474+0000 7f318340e640 1 -- 172.21.15.46:0/2087869518 wait complete. 2024-01-27T14:00:00.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.475+0000 7f318340e640 1 Processor -- start 2024-01-27T14:00:00.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.475+0000 7f318340e640 1 -- start start 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.476+0000 7f318340e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 0x7f317c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.476+0000 7f318340e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c15ae40 0x7f317c1ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.476+0000 7f318340e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0ca890 0x7f317c159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.476+0000 7f318340e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c0ca6a0 con 0x7f317c071140 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.476+0000 7f318340e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1f1450 con 0x7f317c15ae40 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.476+0000 7f318340e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c1e4350 con 0x7f317c0ca890 2024-01-27T14:00:00.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.477+0000 7f31811aa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 0x7f317c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.477+0000 7f31819ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0ca890 0x7f317c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.477+0000 7f31811aa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 0x7f317c14a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53078/0 (socket says 172.21.15.46:53078) 2024-01-27T14:00:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.477+0000 7f31811aa640 1 -- 172.21.15.46:0/2777824870 learned_addr learned my addr 172.21.15.46:0/2777824870 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:00.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.477+0000 7f31809a9640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c15ae40 0x7f317c1ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.480+0000 7f31811aa640 1 -- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0ca890 msgr2=0x7f317c159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.480+0000 7f31811aa640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0ca890 0x7f317c159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.480+0000 7f31811aa640 1 -- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c15ae40 msgr2=0x7f317c1ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.480+0000 7f31811aa640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c15ae40 0x7f317c1ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.480+0000 7f31811aa640 1 -- 172.21.15.46:0/2777824870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740094d0 con 0x7f317c071140 2024-01-27T14:00:00.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.483+0000 7f31811aa640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 0x7f317c14a710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3174000c00 tx=0x7f3174004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.487+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174039c90 con 0x7f317c071140 2024-01-27T14:00:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.487+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3174039df0 con 0x7f317c071140 2024-01-27T14:00:00.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.487+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c1e4610 con 0x7f317c071140 2024-01-27T14:00:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.487+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174043640 con 0x7f317c071140 2024-01-27T14:00:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.487+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c1f0e00 con 0x7f317c071140 2024-01-27T14:00:00.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.488+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c074410 con 0x7f317c071140 2024-01-27T14:00:00.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.755+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f31740437a0 con 0x7f317c071140 2024-01-27T14:00:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.755+0000 7f3179ffb640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f316806af20 0x7f316806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.755+0000 7f31809a9640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f316806af20 0x7f316806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:00.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.756+0000 7f31809a9640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f316806af20 0x7f316806d3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f317c0b0700 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.768+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f317403e070 con 0x7f317c071140 2024-01-27T14:00:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.768+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3174077fc0 con 0x7f317c071140 2024-01-27T14:00:00.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.965+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f317c071890 con 0x7f317c071140 2024-01-27T14:00:00.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.969+0000 7f3179ffb640 1 -- 172.21.15.46:0/2777824870 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f317407b5e0 con 0x7f317c071140 2024-01-27T14:00:00.956 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.971+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f316806af20 msgr2=0x7f316806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.971+0000 7f318340e640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f316806af20 0x7f316806d3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f317c0b0700 tx=0x7f3170009040 comp rx=0 tx=0).stop 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 msgr2=0x7f317c14a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 0x7f317c14a710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3174000c00 tx=0x7f3174004730 comp rx=0 tx=0).stop 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 shutdown_connections 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f316806af20 0x7f316806d3e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f317c0ca890 0x7f317c159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f317c15ae40 0x7f317c1ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 --2- 172.21.15.46:0/2777824870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f317c071140 0x7f317c14a710 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:00.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 >> 172.21.15.46:0/2777824870 conn(0x7f317c0cae90 msgr2=0x7f317c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:00.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 shutdown_connections 2024-01-27T14:00:00.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:00.972+0000 7f318340e640 1 -- 172.21.15.46:0/2777824870 wait complete. 2024-01-27T14:00:00.969 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-01-27T14:00:00.969 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-27T14:00:00.984 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:00:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.139+0000 7faf6949b640 1 Processor -- start 2024-01-27T14:00:01.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 -- start start 2024-01-27T14:00:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf64150500 0x7faf640c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf640bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf640c03f0 0x7faf640c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf640c7780 con 0x7faf640c03f0 2024-01-27T14:00:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf641508e0 con 0x7faf64150500 2024-01-27T14:00:01.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.140+0000 7faf6949b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf64156600 con 0x7faf640c1e80 2024-01-27T14:00:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.141+0000 7faf637fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf640c03f0 0x7faf640c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.141+0000 7faf62ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf64150500 0x7faf640c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.141+0000 7faf627fc640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf640bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.141+0000 7faf637fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7faf640c03f0 0x7faf640c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53080/0 (socket says 172.21.15.46:53080) 2024-01-27T14:00:01.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.141+0000 7faf637fe640 1 -- 172.21.15.46:0/1967430114 learned_addr learned my addr 172.21.15.46:0/1967430114 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:01.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.143+0000 7faf637fe640 1 -- 172.21.15.46:0/1967430114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 msgr2=0x7faf640bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:01.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.143+0000 7faf637fe640 1 --2- 172.21.15.46:0/1967430114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf640bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.143+0000 7faf637fe640 1 -- 172.21.15.46:0/1967430114 >> v2:172.21.15.78:3300/0 conn(0x7faf64150500 msgr2=0x7faf640c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:01.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.143+0000 7faf637fe640 1 --2- 172.21.15.46:0/1967430114 >> v2:172.21.15.78:3300/0 conn(0x7faf64150500 0x7faf640c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.143+0000 7faf637fe640 1 -- 172.21.15.46:0/1967430114 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf641568e0 con 0x7faf640c03f0 2024-01-27T14:00:01.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.145+0000 7faf637fe640 1 --2- 172.21.15.46:0/1967430114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf640c03f0 0x7faf640c6260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faf6406c3b0 tx=0x7faf5c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ddce88e0ce218e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:01.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.149+0000 7faf61ffb640 1 -- 172.21.15.46:0/1967430114 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c02ca70 con 0x7faf640c03f0 2024-01-27T14:00:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.149+0000 7faf61ffb640 1 -- 172.21.15.46:0/1967430114 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c02cbd0 con 0x7faf640c03f0 2024-01-27T14:00:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.149+0000 7faf61ffb640 1 -- 172.21.15.46:0/1967430114 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0343f0 con 0x7faf640c03f0 2024-01-27T14:00:01.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 -- 172.21.15.46:0/1967430114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf640c03f0 msgr2=0x7faf640c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 --2- 172.21.15.46:0/1967430114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf640c03f0 0x7faf640c6260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faf6406c3b0 tx=0x7faf5c02bed0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 -- 172.21.15.46:0/1967430114 shutdown_connections 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 --2- 172.21.15.46:0/1967430114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf640c03f0 0x7faf640c6260 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 --2- 172.21.15.46:0/1967430114 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf640bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 --2- 172.21.15.46:0/1967430114 >> v2:172.21.15.78:3300/0 conn(0x7faf64150500 0x7faf640c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 -- 172.21.15.46:0/1967430114 >> 172.21.15.46:0/1967430114 conn(0x7faf640cae90 msgr2=0x7faf640cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 -- 172.21.15.46:0/1967430114 shutdown_connections 2024-01-27T14:00:01.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.150+0000 7faf6949b640 1 -- 172.21.15.46:0/1967430114 wait complete. 2024-01-27T14:00:01.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.151+0000 7faf6949b640 1 Processor -- start 2024-01-27T14:00:01.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.151+0000 7faf6949b640 1 -- start start 2024-01-27T14:00:01.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf6949b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf640c03f0 0x7faf6414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf6949b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf641f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf6949b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 0x7faf641f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf6949b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64147cd0 con 0x7faf64150500 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf6949b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c3eb0 con 0x7faf640c03f0 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf6949b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf640c2b40 con 0x7faf640c1e80 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 0x7faf641f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.152+0000 7faf637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 0x7faf641f2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53092/0 (socket says 172.21.15.46:53092) 2024-01-27T14:00:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.153+0000 7faf637fe640 1 -- 172.21.15.46:0/1351041528 learned_addr learned my addr 172.21.15.46:0/1351041528 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.153+0000 7faf62ffd640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf640c03f0 0x7faf6414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.153+0000 7faf627fc640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf641f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.156+0000 7faf637fe640 1 -- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 msgr2=0x7faf641f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.156+0000 7faf637fe640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf641f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.156+0000 7faf637fe640 1 -- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf640c03f0 msgr2=0x7faf6414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.156+0000 7faf637fe640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf640c03f0 0x7faf6414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.156+0000 7faf637fe640 1 -- 172.21.15.46:0/1351041528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009b30 con 0x7faf64150500 2024-01-27T14:00:01.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.158+0000 7faf637fe640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 0x7faf641f2940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faf5c02c4e0 tx=0x7faf5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.162+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c007e20 con 0x7faf64150500 2024-01-27T14:00:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.162+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c03e450 con 0x7faf64150500 2024-01-27T14:00:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.162+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c03e800 con 0x7faf64150500 2024-01-27T14:00:01.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.162+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf640c2860 con 0x7faf64150500 2024-01-27T14:00:01.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.162+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf640c3860 con 0x7faf64150500 2024-01-27T14:00:01.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.163+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf64074410 con 0x7faf64150500 2024-01-27T14:00:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.181+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7faf5c03e960 con 0x7faf64150500 2024-01-27T14:00:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.182+0000 7faf4b7fe640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.182+0000 7faf62ffd640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.183+0000 7faf62ffd640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7faf5006af00 0x7faf5006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf54009b40 tx=0x7faf54009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:01.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.437+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf5c07b4a0 con 0x7faf64150500 2024-01-27T14:00:01.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.437+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7faf5c0777e0 con 0x7faf64150500 2024-01-27T14:00:01.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.627+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf640c3ff0 con 0x7faf64150500 2024-01-27T14:00:01.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.670+0000 7faf4b7fe640 1 -- 172.21.15.46:0/1351041528 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7faf5c07ae00 con 0x7faf64150500 2024-01-27T14:00:01.657 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:01.657 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7faf5006af00 msgr2=0x7faf5006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7faf5006af00 0x7faf5006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf54009b40 tx=0x7faf54009190 comp rx=0 tx=0).stop 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 msgr2=0x7faf641f2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 0x7faf641f2940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faf5c02c4e0 tx=0x7faf5c004a40 comp rx=0 tx=0).stop 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 shutdown_connections 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7faf5006af00 0x7faf5006d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf64150500 0x7faf641f2940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7faf640c1e80 0x7faf641f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 --2- 172.21.15.46:0/1351041528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf640c03f0 0x7faf6414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 >> 172.21.15.46:0/1351041528 conn(0x7faf640cae90 msgr2=0x7faf640cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:01.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 shutdown_connections 2024-01-27T14:00:01.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.672+0000 7faf6949b640 1 -- 172.21.15.46:0/1351041528 wait complete. 2024-01-27T14:00:01.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-27T13:31:57.952816+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-27T13:32:10.212389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-27T13:32:11.933652+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-01-27T13:32:15.934129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-27T14:00:01.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-27T14:00:01.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.789+0000 7f0d237ec640 1 Processor -- start 2024-01-27T14:00:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.789+0000 7f0d237ec640 1 -- start start 2024-01-27T14:00:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d237ec640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0d1c153ca0 0x7f0d1c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d237ec640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0d1c0c4750 0x7f0d1c0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d237ec640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c99d0 0x7f0d1c06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d237ec640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c0c6750 con 0x7f0d1c0c4750 2024-01-27T14:00:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d237ec640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c0c9e60 con 0x7f0d1c153ca0 2024-01-27T14:00:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d237ec640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c15a280 con 0x7f0d1c0c99d0 2024-01-27T14:00:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.790+0000 7f0d20d87640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0d1c0c4750 0x7f0d1c0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.791+0000 7f0d20d87640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0d1c0c4750 0x7f0d1c0c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53106/0 (socket says 172.21.15.46:53106) 2024-01-27T14:00:01.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.791+0000 7f0d20d87640 1 -- 172.21.15.46:0/1279252236 learned_addr learned my addr 172.21.15.46:0/1279252236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.791+0000 7f0d21d89640 1 --2- 172.21.15.46:0/1279252236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c99d0 0x7f0d1c06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.791+0000 7f0d21588640 1 --2- 172.21.15.46:0/1279252236 >> v2:172.21.15.78:3300/0 conn(0x7f0d1c153ca0 0x7f0d1c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.793+0000 7f0d20d87640 1 -- 172.21.15.46:0/1279252236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c99d0 msgr2=0x7f0d1c06bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.793+0000 7f0d20d87640 1 --2- 172.21.15.46:0/1279252236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c99d0 0x7f0d1c06bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.793+0000 7f0d20d87640 1 -- 172.21.15.46:0/1279252236 >> v2:172.21.15.78:3300/0 conn(0x7f0d1c153ca0 msgr2=0x7f0d1c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.793+0000 7f0d20d87640 1 --2- 172.21.15.46:0/1279252236 >> v2:172.21.15.78:3300/0 conn(0x7f0d1c153ca0 0x7f0d1c0c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.793+0000 7f0d20d87640 1 -- 172.21.15.46:0/1279252236 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c15a790 con 0x7f0d1c0c4750 2024-01-27T14:00:01.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.795+0000 7f0d20d87640 1 --2- 172.21.15.46:0/1279252236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c0c4750 0x7f0d1c0c5b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c04eac0 tx=0x7f0d0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7904572e340b5b9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d13fff640 1 -- 172.21.15.46:0/1279252236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c030860 con 0x7f0d1c0c4750 2024-01-27T14:00:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d13fff640 1 -- 172.21.15.46:0/1279252236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0309c0 con 0x7f0d1c0c4750 2024-01-27T14:00:01.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d13fff640 1 -- 172.21.15.46:0/1279252236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c030d50 con 0x7f0d1c0c4750 2024-01-27T14:00:01.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 -- 172.21.15.46:0/1279252236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c0c4750 msgr2=0x7f0d1c0c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 --2- 172.21.15.46:0/1279252236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c0c4750 0x7f0d1c0c5b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c04eac0 tx=0x7f0d0c02b9a0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 -- 172.21.15.46:0/1279252236 shutdown_connections 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 --2- 172.21.15.46:0/1279252236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c0c4750 0x7f0d1c0c5b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 --2- 172.21.15.46:0/1279252236 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c99d0 0x7f0d1c06bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 --2- 172.21.15.46:0/1279252236 >> v2:172.21.15.78:3300/0 conn(0x7f0d1c153ca0 0x7f0d1c0c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 -- 172.21.15.46:0/1279252236 >> 172.21.15.46:0/1279252236 conn(0x7f0d1c0cf230 msgr2=0x7f0d1c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.799+0000 7f0d237ec640 1 -- 172.21.15.46:0/1279252236 shutdown_connections 2024-01-27T14:00:01.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.800+0000 7f0d237ec640 1 -- 172.21.15.46:0/1279252236 wait complete. 2024-01-27T14:00:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.801+0000 7f0d237ec640 1 Processor -- start 2024-01-27T14:00:01.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.801+0000 7f0d237ec640 1 -- start start 2024-01-27T14:00:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d237ec640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c4750 0x7f0d1c1efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d237ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d1c0c99d0 0x7f0d1c1f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d237ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 0x7f0d1c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d237ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1f00f0 con 0x7f0d1c153ca0 2024-01-27T14:00:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d237ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1f0b70 con 0x7f0d1c0c99d0 2024-01-27T14:00:01.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d237ec640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1f3650 con 0x7f0d1c0c4750 2024-01-27T14:00:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d21d89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 0x7f0d1c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d21d89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 0x7f0d1c15d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53120/0 (socket says 172.21.15.46:53120) 2024-01-27T14:00:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d21d89640 1 -- 172.21.15.46:0/3569674952 learned_addr learned my addr 172.21.15.46:0/3569674952 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d20d87640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d1c0c99d0 0x7f0d1c1f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.802+0000 7f0d21588640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c4750 0x7f0d1c1efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.806+0000 7f0d21d89640 1 -- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c4750 msgr2=0x7f0d1c1efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.806+0000 7f0d21d89640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c4750 0x7f0d1c1efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.806+0000 7f0d21d89640 1 -- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d1c0c99d0 msgr2=0x7f0d1c1f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:01.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.806+0000 7f0d21d89640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d1c0c99d0 0x7f0d1c1f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:01.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.806+0000 7f0d21d89640 1 -- 172.21.15.46:0/3569674952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0094d0 con 0x7f0d1c153ca0 2024-01-27T14:00:01.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.808+0000 7f0d21d89640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 0x7f0d1c15d530 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009d30 tx=0x7f0d1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.812+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18009ba0 con 0x7f0d1c153ca0 2024-01-27T14:00:01.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.812+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1800f040 con 0x7f0d1c153ca0 2024-01-27T14:00:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.812+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d180146c0 con 0x7f0d1c153ca0 2024-01-27T14:00:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.812+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c1589e0 con 0x7f0d1c153ca0 2024-01-27T14:00:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.812+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c1f05b0 con 0x7f0d1c153ca0 2024-01-27T14:00:01.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:01.813+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c074410 con 0x7f0d1c153ca0 2024-01-27T14:00:02.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.075+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0d18014820 con 0x7f0d1c153ca0 2024-01-27T14:00:02.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.075+0000 7f0d11ffb640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d0006af20 0x7f0d0006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:02.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.075+0000 7f0d21588640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d0006af20 0x7f0d0006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:02.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.076+0000 7f0d21588640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d0006af20 0x7f0d0006d3e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009ac0 tx=0x7f0d14009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.089+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0d180594d0 con 0x7f0d1c153ca0 2024-01-27T14:00:02.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.089+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0d18055810 con 0x7f0d1c153ca0 2024-01-27T14:00:02.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.275+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d1c1f3790 con 0x7f0d1c153ca0 2024-01-27T14:00:02.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.318+0000 7f0d11ffb640 1 -- 172.21.15.46:0/3569674952 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d18018070 con 0x7f0d1c153ca0 2024-01-27T14:00:02.305 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-01-27T14:00:02.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d0006af20 msgr2=0x7f0d0006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d0006af20 0x7f0d0006d3e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009ac0 tx=0x7f0d14009190 comp rx=0 tx=0).stop 2024-01-27T14:00:02.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 msgr2=0x7f0d1c15d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 0x7f0d1c15d530 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009d30 tx=0x7f0d1800c490 comp rx=0 tx=0).stop 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 shutdown_connections 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0d0006af20 0x7f0d0006d3e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d1c153ca0 0x7f0d1c15d530 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d1c0c99d0 0x7f0d1c1f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 --2- 172.21.15.46:0/3569674952 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0d1c0c4750 0x7f0d1c1efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.320+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 >> 172.21.15.46:0/3569674952 conn(0x7f0d1c0cf230 msgr2=0x7f0d1c0c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.321+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 shutdown_connections 2024-01-27T14:00:02.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.321+0000 7f0d237ec640 1 -- 172.21.15.46:0/3569674952 wait complete. 2024-01-27T14:00:02.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-27T14:00:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.438+0000 7fbbafe15640 1 Processor -- start 2024-01-27T14:00:02.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.438+0000 7fbbafe15640 1 -- start start 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.439+0000 7fbbafe15640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbba8159950 0x7fbba8159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.439+0000 7fbbafe15640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba80c9480 con 0x7fbba8153a50 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.439+0000 7fbbafe15640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba815a2c0 con 0x7fbba80c77d0 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.439+0000 7fbbafe15640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80c9740 con 0x7fbba8159950 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.440+0000 7fbbadbb1640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fbba8153a50 0x7fbba80c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37272/0 (socket says 172.21.15.46:37272) 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.440+0000 7fbbadbb1640 1 -- 172.21.15.46:0/3369221699 learned_addr learned my addr 172.21.15.46:0/3369221699 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:02.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.440+0000 7fbbae3b2640 1 --2- 172.21.15.46:0/3369221699 >> v2:172.21.15.78:3300/0 conn(0x7fbba8159950 0x7fbba8159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.442+0000 7fbbacbaf640 1 -- 172.21.15.46:0/3369221699 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620479669 0 0) 0x7fbba80c9480 con 0x7fbba8153a50 2024-01-27T14:00:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.442+0000 7fbbacbaf640 1 -- 172.21.15.46:0/3369221699 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb90003520 con 0x7fbba8153a50 2024-01-27T14:00:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.442+0000 7fbbae3b2640 1 -- 172.21.15.46:0/3369221699 >> v1:172.21.15.78:6789/0 conn(0x7fbba80c77d0 legacy=0x7fbba80c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:02.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.442+0000 7fbbae3b2640 1 -- 172.21.15.46:0/3369221699 >> v1:172.21.15.46:6789/0 conn(0x7fbba8153a50 legacy=0x7fbba80c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.442+0000 7fbbae3b2640 1 -- 172.21.15.46:0/3369221699 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba806bfb0 con 0x7fbba8159950 2024-01-27T14:00:02.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.445+0000 7fbbae3b2640 1 --2- 172.21.15.46:0/3369221699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba8159950 0x7fbba8159d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009d90 tx=0x7fbb9802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252d019bc6d5b2e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.450+0000 7fbbacbaf640 1 -- 172.21.15.46:0/3369221699 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9802cd00 con 0x7fbba8159950 2024-01-27T14:00:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.450+0000 7fbbacbaf640 1 -- 172.21.15.46:0/3369221699 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9802ce60 con 0x7fbba8159950 2024-01-27T14:00:02.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.450+0000 7fbbacbaf640 1 -- 172.21.15.46:0/3369221699 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98034660 con 0x7fbba8159950 2024-01-27T14:00:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.450+0000 7fbbafe15640 1 -- 172.21.15.46:0/3369221699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba8159950 msgr2=0x7fbba8159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.450+0000 7fbbafe15640 1 --2- 172.21.15.46:0/3369221699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba8159950 0x7fbba8159d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009d90 tx=0x7fbb9802bf50 comp rx=0 tx=0).stop 2024-01-27T14:00:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.451+0000 7fbbafe15640 1 -- 172.21.15.46:0/3369221699 shutdown_connections 2024-01-27T14:00:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.451+0000 7fbbafe15640 1 --2- 172.21.15.46:0/3369221699 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba8159950 0x7fbba8159d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.451+0000 7fbbafe15640 1 -- 172.21.15.46:0/3369221699 >> 172.21.15.46:0/3369221699 conn(0x7fbba806efe0 msgr2=0x7fbba806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.451+0000 7fbbafe15640 1 -- 172.21.15.46:0/3369221699 shutdown_connections 2024-01-27T14:00:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.451+0000 7fbbafe15640 1 -- 172.21.15.46:0/3369221699 wait complete. 2024-01-27T14:00:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.452+0000 7fbbafe15640 1 Processor -- start 2024-01-27T14:00:02.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.452+0000 7fbbafe15640 1 -- start start 2024-01-27T14:00:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbafe15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba80c77d0 0x7fbba814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbafe15640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbba8153a50 0x7fbba81eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbafe15640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 0x7fbba80cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbafe15640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8154ae0 con 0x7fbba8159950 2024-01-27T14:00:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbafe15640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8158320 con 0x7fbba80c77d0 2024-01-27T14:00:02.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbafe15640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba81ef800 con 0x7fbba8153a50 2024-01-27T14:00:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbae3b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 0x7fbba80cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbadbb1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba80c77d0 0x7fbba814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbad3b0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbba8153a50 0x7fbba81eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbae3b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 0x7fbba80cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53128/0 (socket says 172.21.15.46:53128) 2024-01-27T14:00:02.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.453+0000 7fbbae3b2640 1 -- 172.21.15.46:0/4097788817 learned_addr learned my addr 172.21.15.46:0/4097788817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.456+0000 7fbbae3b2640 1 -- 172.21.15.46:0/4097788817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbba8153a50 msgr2=0x7fbba81eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.456+0000 7fbbae3b2640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbba8153a50 0x7fbba81eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.456+0000 7fbbae3b2640 1 -- 172.21.15.46:0/4097788817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba80c77d0 msgr2=0x7fbba814d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.456+0000 7fbbae3b2640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba80c77d0 0x7fbba814d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.456+0000 7fbbae3b2640 1 -- 172.21.15.46:0/4097788817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98009a70 con 0x7fbba8159950 2024-01-27T14:00:02.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.459+0000 7fbbae3b2640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 0x7fbba80cbdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009d90 tx=0x7fbb98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.462+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9803d600 con 0x7fbba8159950 2024-01-27T14:00:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.462+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9803d780 con 0x7fbba8159950 2024-01-27T14:00:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.463+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9803db30 con 0x7fbba8159950 2024-01-27T14:00:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.463+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba814ebb0 con 0x7fbba8159950 2024-01-27T14:00:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.463+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba81efa80 con 0x7fbba8159950 2024-01-27T14:00:02.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.463+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba81efc10 con 0x7fbba8159950 2024-01-27T14:00:02.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.725+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbb9803b040 con 0x7fbba8159950 2024-01-27T14:00:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.726+0000 7fbba67fc640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbb9406af20 0x7fbb9406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.726+0000 7fbbadbb1640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbb9406af20 0x7fbb9406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:02.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.726+0000 7fbbadbb1640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbb9406af20 0x7fbb9406d3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbba0005880 tx=0x7fbba0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.739+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbb9807a760 con 0x7fbba8159950 2024-01-27T14:00:02.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.740+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbb98076aa0 con 0x7fbba8159950 2024-01-27T14:00:02.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.920+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbba815a7b0 con 0x7fbba8159950 2024-01-27T14:00:02.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.925+0000 7fbba67fc640 1 -- 172.21.15.46:0/4097788817 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb980390a0 con 0x7fbba8159950 2024-01-27T14:00:02.912 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:00:02.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbb9406af20 msgr2=0x7fbb9406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbb9406af20 0x7fbb9406d3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbba0005880 tx=0x7fbba0009040 comp rx=0 tx=0).stop 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 msgr2=0x7fbba80cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 0x7fbba80cbdb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009d90 tx=0x7fbb98004a40 comp rx=0 tx=0).stop 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 shutdown_connections 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fbb9406af20 0x7fbb9406d3e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbba8159950 0x7fbba80cbdb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fbba8153a50 0x7fbba81eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 --2- 172.21.15.46:0/4097788817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbba80c77d0 0x7fbba814d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 >> 172.21.15.46:0/4097788817 conn(0x7fbba806efe0 msgr2=0x7fbba806f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 shutdown_connections 2024-01-27T14:00:02.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:02.928+0000 7fbbafe15640 1 -- 172.21.15.46:0/4097788817 wait complete. 2024-01-27T14:00:02.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-27T14:00:03.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.044+0000 7f6c69e7c640 1 Processor -- start 2024-01-27T14:00:03.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.044+0000 7f6c69e7c640 1 -- start start 2024-01-27T14:00:03.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.045+0000 7f6c69e7c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4ba0 0x7f6c640b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.045+0000 7f6c69e7c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c640c4f80 0x7f6c640b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.045+0000 7f6c69e7c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6406bcd0 con 0x7f6c640c9d70 2024-01-27T14:00:03.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.045+0000 7f6c69e7c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6406cd00 con 0x7f6c640c4f80 2024-01-27T14:00:03.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.045+0000 7f6c69e7c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6406bf40 con 0x7f6c640c4ba0 2024-01-27T14:00:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.046+0000 7f6c62ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c640c4f80 0x7f6c640b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.046+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4ba0 0x7f6c640b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.046+0000 7f6c62ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c640c4f80 0x7f6c640b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:54952/0 (socket says 172.21.15.46:54952) 2024-01-27T14:00:03.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.046+0000 7f6c62ffd640 1 -- 172.21.15.46:0/3863993565 learned_addr learned my addr 172.21.15.46:0/3863993565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:03.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.048+0000 7f6c637fe640 1 -- 172.21.15.46:0/3863993565 >> v2:172.21.15.78:3300/0 conn(0x7f6c640c4f80 msgr2=0x7f6c640b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:03.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.048+0000 7f6c637fe640 1 --2- 172.21.15.46:0/3863993565 >> v2:172.21.15.78:3300/0 conn(0x7f6c640c4f80 0x7f6c640b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.048+0000 7f6c637fe640 1 -- 172.21.15.46:0/3863993565 >> v1:172.21.15.78:6789/0 conn(0x7f6c640c9d70 legacy=0x7f6c64153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.049+0000 7f6c637fe640 1 -- 172.21.15.46:0/3863993565 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6406c220 con 0x7f6c640c4ba0 2024-01-27T14:00:03.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.050+0000 7f6c637fe640 1 --2- 172.21.15.46:0/3863993565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4ba0 0x7f6c640b2670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c540097a0 tx=0x7f6c5402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1094b2c4e45a32 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.054+0000 7f6c627fc640 1 -- 172.21.15.46:0/3863993565 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54030610 con 0x7f6c640c4ba0 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.054+0000 7f6c627fc640 1 -- 172.21.15.46:0/3863993565 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54030770 con 0x7f6c640c4ba0 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.054+0000 7f6c627fc640 1 -- 172.21.15.46:0/3863993565 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54030b00 con 0x7f6c640c4ba0 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3863993565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4ba0 msgr2=0x7f6c640b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3863993565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4ba0 0x7f6c640b2670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6c540097a0 tx=0x7f6c5402b960 comp rx=0 tx=0).stop 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3863993565 shutdown_connections 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3863993565 >> v2:172.21.15.78:3300/0 conn(0x7f6c640c4f80 0x7f6c640b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3863993565 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4ba0 0x7f6c640b2670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3863993565 >> 172.21.15.46:0/3863993565 conn(0x7f6c6408b6b0 msgr2=0x7f6c640663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3863993565 shutdown_connections 2024-01-27T14:00:03.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.055+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3863993565 wait complete. 2024-01-27T14:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.056+0000 7f6c69e7c640 1 Processor -- start 2024-01-27T14:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.056+0000 7f6c69e7c640 1 -- start start 2024-01-27T14:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c69e7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c640c4ba0 0x7f6c64149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c69e7c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4f80 0x7f6c64157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c69e7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c640c9d70 0x7f6c64158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c69e7c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64149e90 con 0x7f6c640c9d70 2024-01-27T14:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c69e7c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640ce4b0 con 0x7f6c640c4ba0 2024-01-27T14:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c69e7c640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640c8390 con 0x7f6c640c4f80 2024-01-27T14:00:03.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.057+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c640c9d70 0x7f6c64158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.058+0000 7f6c62ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4f80 0x7f6c64157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.058+0000 7f6c637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c640c4ba0 0x7f6c64149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.058+0000 7f6c63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c640c9d70 0x7f6c64158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53136/0 (socket says 172.21.15.46:53136) 2024-01-27T14:00:03.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.058+0000 7f6c63fff640 1 -- 172.21.15.46:0/3332196496 learned_addr learned my addr 172.21.15.46:0/3332196496 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.061+0000 7f6c62ffd640 1 -- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c640c4ba0 msgr2=0x7f6c64149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.061+0000 7f6c62ffd640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c640c4ba0 0x7f6c64149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.061+0000 7f6c62ffd640 1 -- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c640c9d70 msgr2=0x7f6c64158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.061+0000 7f6c62ffd640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c640c9d70 0x7f6c64158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.061+0000 7f6c62ffd640 1 -- 172.21.15.46:0/3332196496 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c54009400 con 0x7f6c640c4f80 2024-01-27T14:00:03.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.064+0000 7f6c62ffd640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4f80 0x7f6c64157ec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800e880 tx=0x7f6c5800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.067+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800c940 con 0x7f6c640c4f80 2024-01-27T14:00:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.067+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5800caa0 con 0x7f6c640c4f80 2024-01-27T14:00:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.067+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800ce30 con 0x7f6c640c4f80 2024-01-27T14:00:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.067+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640c6800 con 0x7f6c640c4f80 2024-01-27T14:00:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.067+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c640c6dc0 con 0x7f6c640c4f80 2024-01-27T14:00:03.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.068+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c640ce660 con 0x7f6c640c4f80 2024-01-27T14:00:03.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.087+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6c58013470 con 0x7f6c640c4f80 2024-01-27T14:00:03.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.087+0000 7f6c4bfff640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6c5006af50 0x7f6c5006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.088+0000 7f6c637fe640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6c5006af50 0x7f6c5006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.088+0000 7f6c637fe640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6c5006af50 0x7f6c5006d410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c54036000 tx=0x7f6c5403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.313+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c58058990 con 0x7f6c640c4f80 2024-01-27T14:00:03.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.324+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6c58054cd0 con 0x7f6c640c4f80 2024-01-27T14:00:03.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.507+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c640ce660 con 0x7f6c640c4f80 2024-01-27T14:00:03.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.512+0000 7f6c4bfff640 1 -- 172.21.15.46:0/3332196496 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c640ce660 con 0x7f6c640c4f80 2024-01-27T14:00:03.499 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-01-27T14:00:03.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.514+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6c5006af50 msgr2=0x7f6c5006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.514+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6c5006af50 0x7f6c5006d410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6c54036000 tx=0x7f6c5403b040 comp rx=0 tx=0).stop 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.514+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4f80 msgr2=0x7f6c64157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.514+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4f80 0x7f6c64157ec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800e880 tx=0x7f6c5800ed40 comp rx=0 tx=0).stop 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 shutdown_connections 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6c5006af50 0x7f6c5006d410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c640c9d70 0x7f6c64158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c640c4f80 0x7f6c64157ec0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 --2- 172.21.15.46:0/3332196496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c640c4ba0 0x7f6c64149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 >> 172.21.15.46:0/3332196496 conn(0x7f6c6408b6b0 msgr2=0x7f6c640b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 shutdown_connections 2024-01-27T14:00:03.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.515+0000 7f6c69e7c640 1 -- 172.21.15.46:0/3332196496 wait complete. 2024-01-27T14:00:03.512 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-01-27T14:00:03.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.632+0000 7f0b5cbce640 1 Processor -- start 2024-01-27T14:00:03.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.632+0000 7f0b5cbce640 1 -- start start 2024-01-27T14:00:03.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.632+0000 7f0b5cbce640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b580c28c0 0x7f0b580c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b5cbce640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b580ccf60 con 0x7f0b580c2ca0 2024-01-27T14:00:03.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b5cbce640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b580ca800 con 0x7f0b58151c00 2024-01-27T14:00:03.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b5cbce640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b581576d0 con 0x7f0b580c28c0 2024-01-27T14:00:03.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b5659c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f0b580c28c0 0x7f0b580c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b56d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0b58151c00 0x7f0b58157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.46:42468/0 (socket says 172.21.15.46:42468) 2024-01-27T14:00:03.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b56d9d640 1 -- 172.21.15.46:0/3908828371 learned_addr learned my addr 172.21.15.46:0/3908828371 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:03.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.633+0000 7f0b4dd9b640 1 --1- 172.21.15.46:0/3908828371 >> v1:172.21.15.46:6789/0 conn(0x7f0b580c2ca0 0x7f0b581514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37284/0 (socket says 172.21.15.46:37284) 2024-01-27T14:00:03.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.636+0000 7f0b55d9b640 1 -- 172.21.15.46:0/3908828371 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563350764 0 0) 0x7f0b580ca800 con 0x7f0b58151c00 2024-01-27T14:00:03.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.636+0000 7f0b55d9b640 1 -- 172.21.15.46:0/3908828371 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b44003520 con 0x7f0b58151c00 2024-01-27T14:00:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.637+0000 7f0b5659c640 1 -- 172.21.15.46:0/3908828371 >> v1:172.21.15.78:6789/0 conn(0x7f0b58151c00 legacy=0x7f0b58157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.637+0000 7f0b5659c640 1 -- 172.21.15.46:0/3908828371 >> v1:172.21.15.46:6789/0 conn(0x7f0b580c2ca0 legacy=0x7f0b581514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.637+0000 7f0b5659c640 1 -- 172.21.15.46:0/3908828371 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b580cd200 con 0x7f0b580c28c0 2024-01-27T14:00:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.642+0000 7f0b5659c640 1 --2- 172.21.15.46:0/3908828371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c28c0 0x7f0b580c1cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b480097a0 tx=0x7f0b4802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3048f20348ee7457 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b55d9b640 1 -- 172.21.15.46:0/3908828371 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48030610 con 0x7f0b580c28c0 2024-01-27T14:00:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b55d9b640 1 -- 172.21.15.46:0/3908828371 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48030770 con 0x7f0b580c28c0 2024-01-27T14:00:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b55d9b640 1 -- 172.21.15.46:0/3908828371 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48030b00 con 0x7f0b580c28c0 2024-01-27T14:00:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b5cbce640 1 -- 172.21.15.46:0/3908828371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c28c0 msgr2=0x7f0b580c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/3908828371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c28c0 0x7f0b580c1cd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b480097a0 tx=0x7f0b4802b960 comp rx=0 tx=0).stop 2024-01-27T14:00:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b5cbce640 1 -- 172.21.15.46:0/3908828371 shutdown_connections 2024-01-27T14:00:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/3908828371 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c28c0 0x7f0b580c1cd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.646+0000 7f0b5cbce640 1 -- 172.21.15.46:0/3908828371 >> 172.21.15.46:0/3908828371 conn(0x7f0b5806efe0 msgr2=0x7f0b5806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.647+0000 7f0b5cbce640 1 -- 172.21.15.46:0/3908828371 shutdown_connections 2024-01-27T14:00:03.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.647+0000 7f0b5cbce640 1 -- 172.21.15.46:0/3908828371 wait complete. 2024-01-27T14:00:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.648+0000 7f0b5cbce640 1 Processor -- start 2024-01-27T14:00:03.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.648+0000 7f0b5cbce640 1 -- start start 2024-01-27T14:00:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5cbce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b580c28c0 0x7f0b580c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5cbce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c2ca0 0x7f0b581479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5cbce640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b58151c00 0x7f0b58147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5cbce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581548d0 con 0x7f0b580c2ca0 2024-01-27T14:00:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5cbce640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b580b2130 con 0x7f0b580c28c0 2024-01-27T14:00:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5cbce640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b58152590 con 0x7f0b58151c00 2024-01-27T14:00:03.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b4dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c2ca0 0x7f0b581479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.649+0000 7f0b5659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b580c28c0 0x7f0b580c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.650+0000 7f0b56d9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b58151c00 0x7f0b58147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.650+0000 7f0b4dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c2ca0 0x7f0b581479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53154/0 (socket says 172.21.15.46:53154) 2024-01-27T14:00:03.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.650+0000 7f0b4dd9b640 1 -- 172.21.15.46:0/254452455 learned_addr learned my addr 172.21.15.46:0/254452455 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.653+0000 7f0b5659c640 1 -- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b58151c00 msgr2=0x7f0b58147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.653+0000 7f0b5659c640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b58151c00 0x7f0b58147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.653+0000 7f0b5659c640 1 -- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c2ca0 msgr2=0x7f0b581479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:03.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.653+0000 7f0b5659c640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c2ca0 0x7f0b581479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:03.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.653+0000 7f0b5659c640 1 -- 172.21.15.46:0/254452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48009400 con 0x7f0b580c28c0 2024-01-27T14:00:03.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.655+0000 7f0b5659c640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b580c28c0 0x7f0b580c89e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b48033000 tx=0x7f0b480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.659+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4803e070 con 0x7f0b580c28c0 2024-01-27T14:00:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.659+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48030e30 con 0x7f0b580c28c0 2024-01-27T14:00:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.659+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48039c50 con 0x7f0b580c28c0 2024-01-27T14:00:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.659+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b58153fa0 con 0x7f0b580c28c0 2024-01-27T14:00:03.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.659+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b58154560 con 0x7f0b580c28c0 2024-01-27T14:00:03.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.660+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b580c5840 con 0x7f0b580c28c0 2024-01-27T14:00:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.678+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0b48055430 con 0x7f0b580c28c0 2024-01-27T14:00:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.679+0000 7f0b4f7fe640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0b3806af20 0x7f0b3806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.679+0000 7f0b4dd9b640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0b3806af20 0x7f0b3806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:03.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.679+0000 7f0b4dd9b640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0b3806af20 0x7f0b3806d3e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b581f3980 tx=0x7f0b40007eb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:03.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.903+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0b4807af40 con 0x7f0b580c28c0 2024-01-27T14:00:03.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:03.913+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0b48077280 con 0x7f0b580c28c0 2024-01-27T14:00:04.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.096+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0b581546f0 con 0x7f0b580c28c0 2024-01-27T14:00:04.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.101+0000 7f0b4f7fe640 1 -- 172.21.15.46:0/254452455 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0b480340a0 con 0x7f0b580c28c0 2024-01-27T14:00:04.088 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-01-27T14:00:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.103+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0b3806af20 msgr2=0x7f0b3806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0b3806af20 0x7f0b3806d3e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0b581f3980 tx=0x7f0b40007eb0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b580c28c0 msgr2=0x7f0b580c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b580c28c0 0x7f0b580c89e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b48033000 tx=0x7f0b480046c0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 shutdown_connections 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f0b3806af20 0x7f0b3806d3e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0b58151c00 0x7f0b58147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b580c2ca0 0x7f0b581479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 --2- 172.21.15.46:0/254452455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b580c28c0 0x7f0b580c89e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 >> 172.21.15.46:0/254452455 conn(0x7f0b5806efe0 msgr2=0x7f0b580c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 shutdown_connections 2024-01-27T14:00:04.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.104+0000 7f0b5cbce640 1 -- 172.21.15.46:0/254452455 wait complete. 2024-01-27T14:00:04.102 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-27T14:00:04.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.217+0000 7f52ba0f5640 1 Processor -- start 2024-01-27T14:00:04.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.217+0000 7f52ba0f5640 1 -- start start 2024-01-27T14:00:04.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.218+0000 7f52ba0f5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c2ca0 0x7f52b41514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:04.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.218+0000 7f52ba0f5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b40ccf60 con 0x7f52b40c77d0 2024-01-27T14:00:04.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.218+0000 7f52ba0f5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b40ca800 con 0x7f52b40c28c0 2024-01-27T14:00:04.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.218+0000 7f52ba0f5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b41576d0 con 0x7f52b40c2ca0 2024-01-27T14:00:04.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.219+0000 7f52b3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f52b40c77d0 0x7f52b4157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:37288/0 (socket says 172.21.15.46:37288) 2024-01-27T14:00:04.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.219+0000 7f52b3fff640 1 -- 172.21.15.46:0/3607221881 learned_addr learned my addr 172.21.15.46:0/3607221881 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:04.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.219+0000 7f52b2ffd640 1 --2- 172.21.15.46:0/3607221881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c2ca0 0x7f52b41514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065117611 0 0) 0x7f52b40ca800 con 0x7f52b40c28c0 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f529c003520 con 0x7f52b40c28c0 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414647146 0 0) 0x7f52b40ccf60 con 0x7f52b40c77d0 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b40ca800 con 0x7f52b40c77d0 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3607221881 >> v1:172.21.15.78:6789/0 conn(0x7f52b40c28c0 legacy=0x7f52b40c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3607221881 >> v1:172.21.15.46:6789/0 conn(0x7f52b40c77d0 legacy=0x7f52b4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.221+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3607221881 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40cd200 con 0x7f52b40c2ca0 2024-01-27T14:00:04.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.223+0000 7f52b2ffd640 1 --2- 172.21.15.46:0/3607221881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c2ca0 0x7f52b41514f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52a80097d0 tx=0x7f52a802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9326e32f711e3b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:04.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.227+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8031890 con 0x7f52b40c2ca0 2024-01-27T14:00:04.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.227+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80319f0 con 0x7f52b40c2ca0 2024-01-27T14:00:04.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.227+0000 7f52b27fc640 1 -- 172.21.15.46:0/3607221881 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8031d80 con 0x7f52b40c2ca0 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3607221881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c2ca0 msgr2=0x7f52b41514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3607221881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c2ca0 0x7f52b41514f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52a80097d0 tx=0x7f52a802b930 comp rx=0 tx=0).stop 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3607221881 shutdown_connections 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3607221881 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c2ca0 0x7f52b41514f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3607221881 >> 172.21.15.46:0/3607221881 conn(0x7f52b406efe0 msgr2=0x7f52b406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3607221881 shutdown_connections 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.228+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3607221881 wait complete. 2024-01-27T14:00:04.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.229+0000 7f52ba0f5640 1 Processor -- start 2024-01-27T14:00:04.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.229+0000 7f52ba0f5640 1 -- start start 2024-01-27T14:00:04.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52ba0f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40c28c0 0x7f52b41f0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:04.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52ba0f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 0x7f52b414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:04.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52ba0f5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c77d0 0x7f52b40cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:04.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52ba0f5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b41f07d0 con 0x7f52b40c2ca0 2024-01-27T14:00:04.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52ba0f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b41edb50 con 0x7f52b40c28c0 2024-01-27T14:00:04.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52ba0f5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b40b1c30 con 0x7f52b40c77d0 2024-01-27T14:00:04.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.230+0000 7f52b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 0x7f52b414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:04.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.231+0000 7f52b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40c28c0 0x7f52b41f0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:04.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.231+0000 7f52b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 0x7f52b414ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53166/0 (socket says 172.21.15.46:53166) 2024-01-27T14:00:04.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.231+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3435023627 learned_addr learned my addr 172.21.15.46:0/3435023627 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:04.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.231+0000 7f52b3fff640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c77d0 0x7f52b40cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:04.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.234+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c77d0 msgr2=0x7f52b40cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.234+0000 7f52b2ffd640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c77d0 0x7f52b40cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.234+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40c28c0 msgr2=0x7f52b41f0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.234+0000 7f52b2ffd640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40c28c0 0x7f52b41f0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.234+0000 7f52b2ffd640 1 -- 172.21.15.46:0/3435023627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8009400 con 0x7f52b40c2ca0 2024-01-27T14:00:04.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.237+0000 7f52b2ffd640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 0x7f52b414ddb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52a80098f0 tx=0x7f52a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:04.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.240+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a803bcb0 con 0x7f52b40c2ca0 2024-01-27T14:00:04.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.240+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a803be10 con 0x7f52b40c2ca0 2024-01-27T14:00:04.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.240+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8045630 con 0x7f52b40c2ca0 2024-01-27T14:00:04.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.240+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b40b1f10 con 0x7f52b40c2ca0 2024-01-27T14:00:04.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.240+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b41f1130 con 0x7f52b40c2ca0 2024-01-27T14:00:04.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.241+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b40b2150 con 0x7f52b40c2ca0 2024-01-27T14:00:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.260+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f52a804e450 con 0x7f52b40c2ca0 2024-01-27T14:00:04.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.261+0000 7f529bfff640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f52a006aed0 0x7f52a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:04.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.261+0000 7f52b37fe640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f52a006aed0 0x7f52a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:04.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.261+0000 7f52b37fe640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f52a006aed0 0x7f52a006d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52a40017b0 tx=0x7f52a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.517+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52a807ab70 con 0x7f52b40c2ca0 2024-01-27T14:00:04.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.517+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f52a8076eb0 con 0x7f52b40c2ca0 2024-01-27T14:00:04.547 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:00:04.549 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:00:04.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.715+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52b4074410 con 0x7f52b40c2ca0 2024-01-27T14:00:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.720+0000 7f529bfff640 1 -- 172.21.15.46:0/3435023627 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52a8035020 con 0x7f52b40c2ca0 2024-01-27T14:00:04.707 INFO:teuthology.orchestra.run.smithi046.stderr:listed 0 entries 2024-01-27T14:00:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f52a006aed0 msgr2=0x7f52a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f52a006aed0 0x7f52a006d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f52a40017b0 tx=0x7f52a4009040 comp rx=0 tx=0).stop 2024-01-27T14:00:04.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 msgr2=0x7f52b414ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 0x7f52b414ddb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52a80098f0 tx=0x7f52a80046c0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 shutdown_connections 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f52a006aed0 0x7f52a006d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f52b40c77d0 0x7f52b40cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b40c2ca0 0x7f52b414ddb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 --2- 172.21.15.46:0/3435023627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b40c28c0 0x7f52b41f0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 >> 172.21.15.46:0/3435023627 conn(0x7f52b406efe0 msgr2=0x7f52b41558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 shutdown_connections 2024-01-27T14:00:04.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:04.723+0000 7f52ba0f5640 1 -- 172.21.15.46:0/3435023627 wait complete. 2024-01-27T14:00:04.720 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-01-27T14:00:04.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:00:04.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-01-27T14:00:04.748 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:00:04.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[45865]: fuse finished with error 0 and tester_r 0 2024-01-27T14:00:05.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:==00:00:26:55.545 45865== 2024-01-27T14:00:05.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:==00:00:26:55.545 45865== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T14:00:05.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T14:00:10.849 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T14:00:10.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:00:10.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:00:10.850 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-27T14:00:10.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:00:10.868 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-01-27T14:00:10.926 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-27T14:00:10.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:00:10.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-27T14:00:10.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-27T14:00:10.999 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-01-27T14:00:11.095 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-27T14:00:11.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-27T14:00:11.105 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:00:11.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.223+0000 7f4ce301e640 1 Processor -- start 2024-01-27T14:00:11.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.223+0000 7f4ce301e640 1 -- start start 2024-01-27T14:00:11.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.224+0000 7f4ce301e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc1518d0 0x7f4cdc06df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.224+0000 7f4ce301e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc06fb40 con 0x7f4cdc0c70e0 2024-01-27T14:00:11.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.224+0000 7f4ce301e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc06b530 con 0x7f4cdc15b520 2024-01-27T14:00:11.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.224+0000 7f4ce301e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc06e990 con 0x7f4cdc1518d0 2024-01-27T14:00:11.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.224+0000 7f4ce15bb640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4cdc0c70e0 0x7f4cdc0c7510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42858/0 (socket says 172.21.15.46:42858) 2024-01-27T14:00:11.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.224+0000 7f4ce15bb640 1 -- 172.21.15.46:0/1019567033 learned_addr learned my addr 172.21.15.46:0/1019567033 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:11.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.225+0000 7f4ce0dba640 1 --2- 172.21.15.46:0/1019567033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc1518d0 0x7f4cdc06df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881858472 0 0) 0x7f4cdc06b530 con 0x7f4cdc15b520 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc4003520 con 0x7f4cdc15b520 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886590602 0 0) 0x7f4cdc06fb40 con 0x7f4cdc0c70e0 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cdc06b530 con 0x7f4cdc0c70e0 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4ce0dba640 1 -- 172.21.15.46:0/1019567033 >> v1:172.21.15.78:6789/0 conn(0x7f4cdc15b520 legacy=0x7f4cdc06a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4ce0dba640 1 -- 172.21.15.46:0/1019567033 >> v1:172.21.15.46:6789/0 conn(0x7f4cdc0c70e0 legacy=0x7f4cdc0c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.227+0000 7f4ce0dba640 1 -- 172.21.15.46:0/1019567033 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc06ec70 con 0x7f4cdc1518d0 2024-01-27T14:00:11.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.230+0000 7f4ce0dba640 1 --2- 172.21.15.46:0/1019567033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc1518d0 0x7f4cdc06df60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80097d0 tx=0x7f4cd802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c004acffe5e415ce server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.234+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8031890 con 0x7f4cdc1518d0 2024-01-27T14:00:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.234+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd80319f0 con 0x7f4cdc1518d0 2024-01-27T14:00:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.234+0000 7f4cd37fe640 1 -- 172.21.15.46:0/1019567033 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8031d80 con 0x7f4cdc1518d0 2024-01-27T14:00:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 -- 172.21.15.46:0/1019567033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc1518d0 msgr2=0x7f4cdc06df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 --2- 172.21.15.46:0/1019567033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc1518d0 0x7f4cdc06df60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80097d0 tx=0x7f4cd802b930 comp rx=0 tx=0).stop 2024-01-27T14:00:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 -- 172.21.15.46:0/1019567033 shutdown_connections 2024-01-27T14:00:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 --2- 172.21.15.46:0/1019567033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc1518d0 0x7f4cdc06df60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 -- 172.21.15.46:0/1019567033 >> 172.21.15.46:0/1019567033 conn(0x7f4cdc0cbf80 msgr2=0x7f4cdc0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 -- 172.21.15.46:0/1019567033 shutdown_connections 2024-01-27T14:00:11.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.235+0000 7f4ce301e640 1 -- 172.21.15.46:0/1019567033 wait complete. 2024-01-27T14:00:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.236+0000 7f4ce301e640 1 Processor -- start 2024-01-27T14:00:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.236+0000 7f4ce301e640 1 -- start start 2024-01-27T14:00:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce301e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc0c70e0 0x7f4cdc14a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce301e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cdc1518d0 0x7f4cdc14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce301e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 0x7f4cdc1f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce301e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc14b040 con 0x7f4cdc15b520 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce301e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc14aca0 con 0x7f4cdc1518d0 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce301e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc14cc70 con 0x7f4cdc0c70e0 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce15bb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 0x7f4cdc1f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4ce0dba640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc0c70e0 0x7f4cdc14a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.237+0000 7f4cd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cdc1518d0 0x7f4cdc14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.238+0000 7f4ce15bb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 0x7f4cdc1f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37072/0 (socket says 172.21.15.46:37072) 2024-01-27T14:00:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.238+0000 7f4ce15bb640 1 -- 172.21.15.46:0/4108878941 learned_addr learned my addr 172.21.15.46:0/4108878941 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.241+0000 7f4ce15bb640 1 -- 172.21.15.46:0/4108878941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc0c70e0 msgr2=0x7f4cdc14a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.241+0000 7f4ce15bb640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc0c70e0 0x7f4cdc14a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.241+0000 7f4ce15bb640 1 -- 172.21.15.46:0/4108878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cdc1518d0 msgr2=0x7f4cdc14ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.241+0000 7f4ce15bb640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cdc1518d0 0x7f4cdc14ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.241+0000 7f4ce15bb640 1 -- 172.21.15.46:0/4108878941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8009400 con 0x7f4cdc15b520 2024-01-27T14:00:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.244+0000 7f4ce15bb640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 0x7f4cdc1f22f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400cad0 tx=0x7f4cd400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:11.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.247+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400abd0 con 0x7f4cdc15b520 2024-01-27T14:00:11.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.247+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400ad30 con 0x7f4cdc15b520 2024-01-27T14:00:11.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.247+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc14a9e0 con 0x7f4cdc15b520 2024-01-27T14:00:11.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.247+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400aea0 con 0x7f4cdc15b520 2024-01-27T14:00:11.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.247+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc14c620 con 0x7f4cdc15b520 2024-01-27T14:00:11.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.248+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc14ce00 con 0x7f4cdc15b520 2024-01-27T14:00:11.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.267+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4cd4007070 con 0x7f4cdc15b520 2024-01-27T14:00:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.267+0000 7f4cd17fa640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4cc806af20 0x7f4cc806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.267+0000 7f4ce0dba640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4cc806af20 0x7f4cc806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.268+0000 7f4ce0dba640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4cc806af20 0x7f4cc806d3e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8036000 tx=0x7f4cd803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:11.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.270+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4cd4058600 con 0x7f4cdc15b520 2024-01-27T14:00:11.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.520+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4cd4054940 con 0x7f4cdc15b520 2024-01-27T14:00:11.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.701+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cdc070070 con 0x7f4cc806af20 2024-01-27T14:00:11.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.711+0000 7f4cd17fa640 1 -- 172.21.15.46:0/4108878941 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371405 (secure 0 0 0) 0x7f4cd803a420 con 0x7f4cc806af20 2024-01-27T14:00:11.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:11.708 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4cc806af20 msgr2=0x7f4cc806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4cc806af20 0x7f4cc806d3e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8036000 tx=0x7f4cd803c040 comp rx=0 tx=0).stop 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 msgr2=0x7f4cdc1f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 0x7f4cdc1f22f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400cad0 tx=0x7f4cd400cf90 comp rx=0 tx=0).stop 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 shutdown_connections 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4cc806af20 0x7f4cc806d3e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cdc15b520 0x7f4cdc1f22f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4cdc1518d0 0x7f4cdc14ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 --2- 172.21.15.46:0/4108878941 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4cdc0c70e0 0x7f4cdc14a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 >> 172.21.15.46:0/4108878941 conn(0x7f4cdc0cbf80 msgr2=0x7f4cdc0cb660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:11.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 shutdown_connections 2024-01-27T14:00:11.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.715+0000 7f4ce301e640 1 -- 172.21.15.46:0/4108878941 wait complete. 2024-01-27T14:00:11.713 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":868,"stamp":"2024-01-27T14:00:09.948034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38431928,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1007,"num_read_kb":1043,"num_write":12365,"num_write_kb":342097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14529,"ondisk_log_size":14529,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397984,"kb_used_data":52832,"kb_used_omap":12,"kb_used_meta":345075,"kb_avail":754576736,"statfs":{"total":773094113280,"available":772686577664,"internally_reserved":0,"allocated":54099968,"data_stored":77794048,"data_compressed":7048892,"data_compressed_allocated":10846208,"data_compressed_original":35938304,"omap_allocated":12752,"internal_metadata":353357360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131521,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8,"num_write":31,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002844"},"pg_stats":[{"pgid":"2.1f","version":"27'623","reported_seq":662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:17.541406+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:59:17.541406+0000","last_peered":"2024-01-27T13:59:17.541406+0000","last_clean":"2024-01-27T13:59:17.541406+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:59:17.541406+0000","last_undegraded":"2024-01-27T13:59:17.541406+0000","last_fullsized":"2024-01-27T13:59:17.541406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'26","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010332+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T14:00:05.010332+0000","last_peered":"2024-01-27T14:00:05.010332+0000","last_clean":"2024-01-27T14:00:05.010332+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T14:00:05.010332+0000","last_undegraded":"2024-01-27T14:00:05.010332+0000","last_fullsized":"2024-01-27T14:00:05.010332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'150","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.965054+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:59:30.965054+0000","last_peered":"2024-01-27T13:59:30.965054+0000","last_clean":"2024-01-27T13:59:30.965054+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:59:30.965054+0000","last_undegraded":"2024-01-27T13:59:30.965054+0000","last_fullsized":"2024-01-27T13:59:30.965054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'716","reported_seq":755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.518984+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:59:49.518984+0000","last_peered":"2024-01-27T13:59:49.518984+0000","last_clean":"2024-01-27T13:59:49.518984+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:59:49.518984+0000","last_undegraded":"2024-01-27T13:59:49.518984+0000","last_fullsized":"2024-01-27T13:59:49.518984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185102+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T14:00:05.185102+0000","last_peered":"2024-01-27T14:00:05.185102+0000","last_clean":"2024-01-27T14:00:05.185102+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T14:00:05.185102+0000","last_undegraded":"2024-01-27T14:00:05.185102+0000","last_fullsized":"2024-01-27T14:00:05.185102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'132","reported_seq":161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787902+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:59:30.787902+0000","last_peered":"2024-01-27T13:59:30.787902+0000","last_clean":"2024-01-27T13:59:30.787902+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:59:30.787902+0000","last_undegraded":"2024-01-27T13:59:30.787902+0000","last_fullsized":"2024-01-27T13:59:30.787902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1388","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.618629+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:59:53.618629+0000","last_peered":"2024-01-27T13:59:53.618629+0000","last_clean":"2024-01-27T13:59:53.618629+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:59:53.618629+0000","last_undegraded":"2024-01-27T13:59:53.618629+0000","last_fullsized":"2024-01-27T13:59:53.618629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059839+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T14:00:05.059839+0000","last_peered":"2024-01-27T14:00:05.059839+0000","last_clean":"2024-01-27T14:00:05.059839+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T14:00:05.059839+0000","last_undegraded":"2024-01-27T14:00:05.059839+0000","last_fullsized":"2024-01-27T14:00:05.059839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'121","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.998050+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:59:33.998050+0000","last_peered":"2024-01-27T13:59:33.998050+0000","last_clean":"2024-01-27T13:59:33.998050+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:59:33.998050+0000","last_undegraded":"2024-01-27T13:59:33.998050+0000","last_fullsized":"2024-01-27T13:59:33.998050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:45.339471+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:59:45.339471+0000","last_peered":"2024-01-27T13:59:45.339471+0000","last_clean":"2024-01-27T13:59:45.339471+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:59:45.339471+0000","last_undegraded":"2024-01-27T13:59:45.339471+0000","last_fullsized":"2024-01-27T13:59:45.339471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.021532+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T14:00:05.021532+0000","last_peered":"2024-01-27T14:00:05.021532+0000","last_clean":"2024-01-27T14:00:05.021532+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T14:00:05.021532+0000","last_undegraded":"2024-01-27T14:00:05.021532+0000","last_fullsized":"2024-01-27T14:00:05.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'126","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.124660+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:59:32.124660+0000","last_peered":"2024-01-27T13:59:32.124660+0000","last_clean":"2024-01-27T13:59:32.124660+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:59:32.124660+0000","last_undegraded":"2024-01-27T13:59:32.124660+0000","last_fullsized":"2024-01-27T13:59:32.124660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085606+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T14:00:05.085606+0000","last_peered":"2024-01-27T14:00:05.085606+0000","last_clean":"2024-01-27T14:00:05.085606+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T14:00:05.085606+0000","last_undegraded":"2024-01-27T14:00:05.085606+0000","last_fullsized":"2024-01-27T14:00:05.085606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'617","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617302+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:59:53.617302+0000","last_peered":"2024-01-27T13:59:53.617302+0000","last_clean":"2024-01-27T13:59:53.617302+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:59:53.617302+0000","last_undegraded":"2024-01-27T13:59:53.617302+0000","last_fullsized":"2024-01-27T13:59:53.617302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'102","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:27.902717+0000","last_change":"2024-01-27T13:32:51.707357+0000","last_active":"2024-01-27T13:59:27.902717+0000","last_peered":"2024-01-27T13:59:27.902717+0000","last_clean":"2024-01-27T13:59:27.902717+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T13:59:27.902717+0000","last_undegraded":"2024-01-27T13:59:27.902717+0000","last_fullsized":"2024-01-27T13:59:27.902717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:36:27.470407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.007850+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T14:00:05.007850+0000","last_peered":"2024-01-27T14:00:05.007850+0000","last_clean":"2024-01-27T14:00:05.007850+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T14:00:05.007850+0000","last_undegraded":"2024-01-27T14:00:05.007850+0000","last_fullsized":"2024-01-27T14:00:05.007850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:19.587073+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:58:19.587073+0000","last_peered":"2024-01-27T13:58:19.587073+0000","last_clean":"2024-01-27T13:58:19.587073+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:58:19.587073+0000","last_undegraded":"2024-01-27T13:58:19.587073+0000","last_fullsized":"2024-01-27T13:58:19.587073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'162","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787700+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:59:30.787700+0000","last_peered":"2024-01-27T13:59:30.787700+0000","last_clean":"2024-01-27T13:59:30.787700+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:59:30.787700+0000","last_undegraded":"2024-01-27T13:59:30.787700+0000","last_fullsized":"2024-01-27T13:59:30.787700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":10103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'33","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067491+0000","last_change":"2024-01-27T13:32:51.715993+0000","last_active":"2024-01-27T14:00:05.067491+0000","last_peered":"2024-01-27T14:00:05.067491+0000","last_clean":"2024-01-27T14:00:05.067491+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T14:00:05.067491+0000","last_undegraded":"2024-01-27T14:00:05.067491+0000","last_fullsized":"2024-01-27T14:00:05.067491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.481531+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:59:47.481531+0000","last_peered":"2024-01-27T13:59:47.481531+0000","last_clean":"2024-01-27T13:59:47.481531+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:59:47.481531+0000","last_undegraded":"2024-01-27T13:59:47.481531+0000","last_fullsized":"2024-01-27T13:59:47.481531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'135","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.546165+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:59:32.546165+0000","last_peered":"2024-01-27T13:59:32.546165+0000","last_clean":"2024-01-27T13:59:32.546165+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:59:32.546165+0000","last_undegraded":"2024-01-27T13:59:32.546165+0000","last_fullsized":"2024-01-27T13:59:32.546165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.532444+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:59:32.532444+0000","last_peered":"2024-01-27T13:59:32.532444+0000","last_clean":"2024-01-27T13:59:32.532444+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:59:32.532444+0000","last_undegraded":"2024-01-27T13:59:32.532444+0000","last_fullsized":"2024-01-27T13:59:32.532444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617100+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:59:53.617100+0000","last_peered":"2024-01-27T13:59:53.617100+0000","last_clean":"2024-01-27T13:59:53.617100+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:59:53.617100+0000","last_undegraded":"2024-01-27T13:59:53.617100+0000","last_fullsized":"2024-01-27T13:59:53.617100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'105","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217803+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:59:33.217803+0000","last_peered":"2024-01-27T13:59:33.217803+0000","last_clean":"2024-01-27T13:59:33.217803+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:59:33.217803+0000","last_undegraded":"2024-01-27T13:59:33.217803+0000","last_fullsized":"2024-01-27T13:59:33.217803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":9310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183310+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T14:00:05.183310+0000","last_peered":"2024-01-27T14:00:05.183310+0000","last_clean":"2024-01-27T14:00:05.183310+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T14:00:05.183310+0000","last_undegraded":"2024-01-27T14:00:05.183310+0000","last_fullsized":"2024-01-27T14:00:05.183310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632858+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:59:55.632858+0000","last_peered":"2024-01-27T13:59:55.632858+0000","last_clean":"2024-01-27T13:59:55.632858+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:59:55.632858+0000","last_undegraded":"2024-01-27T13:59:55.632858+0000","last_fullsized":"2024-01-27T13:59:55.632858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'127","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.215260+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:59:33.215260+0000","last_peered":"2024-01-27T13:59:33.215260+0000","last_clean":"2024-01-27T13:59:33.215260+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:59:33.215260+0000","last_undegraded":"2024-01-27T13:59:33.215260+0000","last_fullsized":"2024-01-27T13:59:33.215260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":6403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015387+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T14:00:05.015387+0000","last_peered":"2024-01-27T14:00:05.015387+0000","last_clean":"2024-01-27T14:00:05.015387+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T14:00:05.015387+0000","last_undegraded":"2024-01-27T14:00:05.015387+0000","last_fullsized":"2024-01-27T14:00:05.015387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'309","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.629384+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:59:58.629384+0000","last_peered":"2024-01-27T13:59:58.629384+0000","last_clean":"2024-01-27T13:59:58.629384+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:59:58.629384+0000","last_undegraded":"2024-01-27T13:59:58.629384+0000","last_fullsized":"2024-01-27T13:59:58.629384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'143","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.047231+0000","last_change":"2024-01-27T13:32:51.674638+0000","last_active":"2024-01-27T13:59:35.047231+0000","last_peered":"2024-01-27T13:59:35.047231+0000","last_clean":"2024-01-27T13:59:35.047231+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T13:59:35.047231+0000","last_undegraded":"2024-01-27T13:59:35.047231+0000","last_fullsized":"2024-01-27T13:59:35.047231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:38.395479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999864+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T14:00:04.999864+0000","last_peered":"2024-01-27T14:00:04.999864+0000","last_clean":"2024-01-27T14:00:04.999864+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T14:00:04.999864+0000","last_undegraded":"2024-01-27T14:00:04.999864+0000","last_fullsized":"2024-01-27T14:00:04.999864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:43.240701+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:59:43.240701+0000","last_peered":"2024-01-27T13:59:43.240701+0000","last_clean":"2024-01-27T13:59:43.240701+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:59:43.240701+0000","last_undegraded":"2024-01-27T13:59:43.240701+0000","last_fullsized":"2024-01-27T13:59:43.240701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'116","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217955+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:59:33.217955+0000","last_peered":"2024-01-27T13:59:33.217955+0000","last_clean":"2024-01-27T13:59:33.217955+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:59:33.217955+0000","last_undegraded":"2024-01-27T13:59:33.217955+0000","last_fullsized":"2024-01-27T13:59:33.217955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017991+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T14:00:05.017991+0000","last_peered":"2024-01-27T14:00:05.017991+0000","last_clean":"2024-01-27T14:00:05.017991+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T14:00:05.017991+0000","last_undegraded":"2024-01-27T14:00:05.017991+0000","last_fullsized":"2024-01-27T14:00:05.017991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:50.528116+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:59:50.528116+0000","last_peered":"2024-01-27T13:59:50.528116+0000","last_clean":"2024-01-27T13:59:50.528116+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:59:50.528116+0000","last_undegraded":"2024-01-27T13:59:50.528116+0000","last_fullsized":"2024-01-27T13:59:50.528116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'170","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.545398+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:59:32.545398+0000","last_peered":"2024-01-27T13:59:32.545398+0000","last_clean":"2024-01-27T13:59:32.545398+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:59:32.545398+0000","last_undegraded":"2024-01-27T13:59:32.545398+0000","last_fullsized":"2024-01-27T13:59:32.545398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010376+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T14:00:05.010376+0000","last_peered":"2024-01-27T14:00:05.010376+0000","last_clean":"2024-01-27T14:00:05.010376+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T14:00:05.010376+0000","last_undegraded":"2024-01-27T14:00:05.010376+0000","last_fullsized":"2024-01-27T14:00:05.010376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.205445+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:59:42.205445+0000","last_peered":"2024-01-27T13:59:42.205445+0000","last_clean":"2024-01-27T13:59:42.205445+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:59:42.205445+0000","last_undegraded":"2024-01-27T13:59:42.205445+0000","last_fullsized":"2024-01-27T13:59:42.205445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'103","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.218046+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:59:33.218046+0000","last_peered":"2024-01-27T13:59:33.218046+0000","last_clean":"2024-01-27T13:59:33.218046+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:59:33.218046+0000","last_undegraded":"2024-01-27T13:59:33.218046+0000","last_fullsized":"2024-01-27T13:59:33.218046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999823+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T14:00:04.999823+0000","last_peered":"2024-01-27T14:00:04.999823+0000","last_clean":"2024-01-27T14:00:04.999823+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T14:00:04.999823+0000","last_undegraded":"2024-01-27T14:00:04.999823+0000","last_fullsized":"2024-01-27T14:00:04.999823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'896","reported_seq":1826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:00.617248+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T14:00:00.617248+0000","last_peered":"2024-01-27T14:00:00.617248+0000","last_clean":"2024-01-27T14:00:00.617248+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T14:00:00.617248+0000","last_undegraded":"2024-01-27T14:00:00.617248+0000","last_fullsized":"2024-01-27T14:00:00.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198130,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":891,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'141","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.444760+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:59:36.444760+0000","last_peered":"2024-01-27T13:59:36.444760+0000","last_clean":"2024-01-27T13:59:36.444760+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:59:36.444760+0000","last_undegraded":"2024-01-27T13:59:36.444760+0000","last_fullsized":"2024-01-27T13:59:36.444760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":10872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183662+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T14:00:05.183662+0000","last_peered":"2024-01-27T14:00:05.183662+0000","last_clean":"2024-01-27T14:00:05.183662+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T14:00:05.183662+0000","last_undegraded":"2024-01-27T14:00:05.183662+0000","last_fullsized":"2024-01-27T14:00:05.183662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'433","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.819081+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T14:00:04.819081+0000","last_peered":"2024-01-27T14:00:04.819081+0000","last_clean":"2024-01-27T14:00:04.819081+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T14:00:04.819081+0000","last_undegraded":"2024-01-27T14:00:04.819081+0000","last_fullsized":"2024-01-27T14:00:04.819081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087528,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'130","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.997593+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:59:33.997593+0000","last_peered":"2024-01-27T13:59:33.997593+0000","last_clean":"2024-01-27T13:59:33.997593+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:59:33.997593+0000","last_undegraded":"2024-01-27T13:59:33.997593+0000","last_fullsized":"2024-01-27T13:59:33.997593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":9704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013424+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T14:00:05.013424+0000","last_peered":"2024-01-27T14:00:05.013424+0000","last_clean":"2024-01-27T14:00:05.013424+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T14:00:05.013424+0000","last_undegraded":"2024-01-27T14:00:05.013424+0000","last_fullsized":"2024-01-27T14:00:05.013424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.520681+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:59:49.520681+0000","last_peered":"2024-01-27T13:59:49.520681+0000","last_clean":"2024-01-27T13:59:49.520681+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:59:49.520681+0000","last_undegraded":"2024-01-27T13:59:49.520681+0000","last_fullsized":"2024-01-27T13:59:49.520681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:08.571285+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:58:08.571285+0000","last_peered":"2024-01-27T13:58:08.571285+0000","last_clean":"2024-01-27T13:58:08.571285+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:58:08.571285+0000","last_undegraded":"2024-01-27T13:58:08.571285+0000","last_fullsized":"2024-01-27T13:58:08.571285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'154","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.219333+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:59:33.219333+0000","last_peered":"2024-01-27T13:59:33.219333+0000","last_clean":"2024-01-27T13:59:33.219333+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:59:33.219333+0000","last_undegraded":"2024-01-27T13:59:33.219333+0000","last_fullsized":"2024-01-27T13:59:33.219333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'32","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.098651+0000","last_change":"2024-01-27T13:32:51.718659+0000","last_active":"2024-01-27T14:00:05.098651+0000","last_peered":"2024-01-27T14:00:05.098651+0000","last_clean":"2024-01-27T14:00:05.098651+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T14:00:05.098651+0000","last_undegraded":"2024-01-27T14:00:05.098651+0000","last_fullsized":"2024-01-27T14:00:05.098651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:10:31.041312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:14.547664+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:59:14.547664+0000","last_peered":"2024-01-27T13:59:14.547664+0000","last_clean":"2024-01-27T13:59:14.547664+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:59:14.547664+0000","last_undegraded":"2024-01-27T13:59:14.547664+0000","last_fullsized":"2024-01-27T13:59:14.547664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'132","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:23.537428+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:59:23.537428+0000","last_peered":"2024-01-27T13:59:23.537428+0000","last_clean":"2024-01-27T13:59:23.537428+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:59:23.537428+0000","last_undegraded":"2024-01-27T13:59:23.537428+0000","last_fullsized":"2024-01-27T13:59:23.537428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":6638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'36","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067694+0000","last_change":"2024-01-27T13:32:51.673578+0000","last_active":"2024-01-27T14:00:05.067694+0000","last_peered":"2024-01-27T14:00:05.067694+0000","last_clean":"2024-01-27T14:00:05.067694+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T14:00:05.067694+0000","last_undegraded":"2024-01-27T14:00:05.067694+0000","last_fullsized":"2024-01-27T14:00:05.067694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:14.591258+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:59:14.591258+0000","last_peered":"2024-01-27T13:59:14.591258+0000","last_clean":"2024-01-27T13:59:14.591258+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:59:14.591258+0000","last_undegraded":"2024-01-27T13:59:14.591258+0000","last_fullsized":"2024-01-27T13:59:14.591258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'178","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100045+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:59:35.100045+0000","last_peered":"2024-01-27T13:59:35.100045+0000","last_clean":"2024-01-27T13:59:35.100045+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:59:35.100045+0000","last_undegraded":"2024-01-27T13:59:35.100045+0000","last_fullsized":"2024-01-27T13:59:35.100045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":15130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085883+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T14:00:05.085883+0000","last_peered":"2024-01-27T14:00:05.085883+0000","last_clean":"2024-01-27T14:00:05.085883+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T14:00:05.085883+0000","last_undegraded":"2024-01-27T14:00:05.085883+0000","last_fullsized":"2024-01-27T14:00:05.085883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.207807+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:59:42.207807+0000","last_peered":"2024-01-27T13:59:42.207807+0000","last_clean":"2024-01-27T13:59:42.207807+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:59:42.207807+0000","last_undegraded":"2024-01-27T13:59:42.207807+0000","last_fullsized":"2024-01-27T13:59:42.207807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'133","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.996698+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:59:33.996698+0000","last_peered":"2024-01-27T13:59:33.996698+0000","last_clean":"2024-01-27T13:59:33.996698+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:59:33.996698+0000","last_undegraded":"2024-01-27T13:59:33.996698+0000","last_fullsized":"2024-01-27T13:59:33.996698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085515+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T14:00:05.085515+0000","last_peered":"2024-01-27T14:00:05.085515+0000","last_clean":"2024-01-27T14:00:05.085515+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T14:00:05.085515+0000","last_undegraded":"2024-01-27T14:00:05.085515+0000","last_fullsized":"2024-01-27T14:00:05.085515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:18.507104+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:59:18.507104+0000","last_peered":"2024-01-27T13:59:18.507104+0000","last_clean":"2024-01-27T13:59:18.507104+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:59:18.507104+0000","last_undegraded":"2024-01-27T13:59:18.507104+0000","last_fullsized":"2024-01-27T13:59:18.507104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'153","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.502177+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:59:32.502177+0000","last_peered":"2024-01-27T13:59:32.502177+0000","last_clean":"2024-01-27T13:59:32.502177+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:59:32.502177+0000","last_undegraded":"2024-01-27T13:59:32.502177+0000","last_fullsized":"2024-01-27T13:59:32.502177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":10566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083297+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T14:00:05.083297+0000","last_peered":"2024-01-27T14:00:05.083297+0000","last_clean":"2024-01-27T14:00:05.083297+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T14:00:05.083297+0000","last_undegraded":"2024-01-27T14:00:05.083297+0000","last_fullsized":"2024-01-27T14:00:05.083297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.746872+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:59:58.746872+0000","last_peered":"2024-01-27T13:59:58.746872+0000","last_clean":"2024-01-27T13:59:58.746872+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:59:58.746872+0000","last_undegraded":"2024-01-27T13:59:58.746872+0000","last_fullsized":"2024-01-27T13:59:58.746872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'137","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.097101+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:59:35.097101+0000","last_peered":"2024-01-27T13:59:35.097101+0000","last_clean":"2024-01-27T13:59:35.097101+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:59:35.097101+0000","last_undegraded":"2024-01-27T13:59:35.097101+0000","last_fullsized":"2024-01-27T13:59:35.097101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":8266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.073366+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T14:00:05.073366+0000","last_peered":"2024-01-27T14:00:05.073366+0000","last_clean":"2024-01-27T14:00:05.073366+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T14:00:05.073366+0000","last_undegraded":"2024-01-27T14:00:05.073366+0000","last_fullsized":"2024-01-27T14:00:05.073366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:51.881725+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:59:51.881725+0000","last_peered":"2024-01-27T13:59:51.881725+0000","last_clean":"2024-01-27T13:59:51.881725+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:59:51.881725+0000","last_undegraded":"2024-01-27T13:59:51.881725+0000","last_fullsized":"2024-01-27T13:59:51.881725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107798+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:59:35.107798+0000","last_peered":"2024-01-27T13:59:35.107798+0000","last_clean":"2024-01-27T13:59:35.107798+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:59:35.107798+0000","last_undegraded":"2024-01-27T13:59:35.107798+0000","last_fullsized":"2024-01-27T13:59:35.107798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":8731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.126365+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T14:00:05.126365+0000","last_peered":"2024-01-27T14:00:05.126365+0000","last_clean":"2024-01-27T14:00:05.126365+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T14:00:05.126365+0000","last_undegraded":"2024-01-27T14:00:05.126365+0000","last_fullsized":"2024-01-27T14:00:05.126365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.630242+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:59:55.630242+0000","last_peered":"2024-01-27T13:59:55.630242+0000","last_clean":"2024-01-27T13:59:55.630242+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:59:55.630242+0000","last_undegraded":"2024-01-27T13:59:55.630242+0000","last_fullsized":"2024-01-27T13:59:55.630242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'100","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.778713+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:59:30.778713+0000","last_peered":"2024-01-27T13:59:30.778713+0000","last_clean":"2024-01-27T13:59:30.778713+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:59:30.778713+0000","last_undegraded":"2024-01-27T13:59:30.778713+0000","last_fullsized":"2024-01-27T13:59:30.778713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183338+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T14:00:05.183338+0000","last_peered":"2024-01-27T14:00:05.183338+0000","last_clean":"2024-01-27T14:00:05.183338+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T14:00:05.183338+0000","last_undegraded":"2024-01-27T14:00:05.183338+0000","last_fullsized":"2024-01-27T14:00:05.183338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.454697+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:59:47.454697+0000","last_peered":"2024-01-27T13:59:47.454697+0000","last_clean":"2024-01-27T13:59:47.454697+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:59:47.454697+0000","last_undegraded":"2024-01-27T13:59:47.454697+0000","last_fullsized":"2024-01-27T13:59:47.454697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'140","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.108071+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:59:35.108071+0000","last_peered":"2024-01-27T13:59:35.108071+0000","last_clean":"2024-01-27T13:59:35.108071+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:59:35.108071+0000","last_undegraded":"2024-01-27T13:59:35.108071+0000","last_fullsized":"2024-01-27T13:59:35.108071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":9178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083080+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T14:00:05.083080+0000","last_peered":"2024-01-27T14:00:05.083080+0000","last_clean":"2024-01-27T14:00:05.083080+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T14:00:05.083080+0000","last_undegraded":"2024-01-27T14:00:05.083080+0000","last_fullsized":"2024-01-27T14:00:05.083080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'861","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.482095+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:59:47.482095+0000","last_peered":"2024-01-27T13:59:47.482095+0000","last_clean":"2024-01-27T13:59:47.482095+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:59:47.482095+0000","last_undegraded":"2024-01-27T13:59:47.482095+0000","last_fullsized":"2024-01-27T13:59:47.482095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":4566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'134","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100208+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:59:35.100208+0000","last_peered":"2024-01-27T13:59:35.100208+0000","last_clean":"2024-01-27T13:59:35.100208+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:59:35.100208+0000","last_undegraded":"2024-01-27T13:59:35.100208+0000","last_fullsized":"2024-01-27T13:59:35.100208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018832+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T14:00:05.018832+0000","last_peered":"2024-01-27T14:00:05.018832+0000","last_clean":"2024-01-27T14:00:05.018832+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T14:00:05.018832+0000","last_undegraded":"2024-01-27T14:00:05.018832+0000","last_fullsized":"2024-01-27T14:00:05.018832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'604","reported_seq":641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.760089+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:59:58.760089+0000","last_peered":"2024-01-27T13:59:58.760089+0000","last_clean":"2024-01-27T13:59:58.760089+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:59:58.760089+0000","last_undegraded":"2024-01-27T13:59:58.760089+0000","last_fullsized":"2024-01-27T13:59:58.760089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'142","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.103737+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:59:35.103737+0000","last_peered":"2024-01-27T13:59:35.103737+0000","last_clean":"2024-01-27T13:59:35.103737+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:59:35.103737+0000","last_undegraded":"2024-01-27T13:59:35.103737+0000","last_fullsized":"2024-01-27T13:59:35.103737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":22998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185092+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T14:00:05.185092+0000","last_peered":"2024-01-27T14:00:05.185092+0000","last_clean":"2024-01-27T14:00:05.185092+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T14:00:05.185092+0000","last_undegraded":"2024-01-27T14:00:05.185092+0000","last_fullsized":"2024-01-27T14:00:05.185092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.195625+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:59:42.195625+0000","last_peered":"2024-01-27T13:59:42.195625+0000","last_clean":"2024-01-27T13:59:42.195625+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:59:42.195625+0000","last_undegraded":"2024-01-27T13:59:42.195625+0000","last_fullsized":"2024-01-27T13:59:42.195625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'115","reported_seq":144,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:25.616499+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:59:25.616499+0000","last_peered":"2024-01-27T13:59:25.616499+0000","last_clean":"2024-01-27T13:59:25.616499+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:59:25.616499+0000","last_undegraded":"2024-01-27T13:59:25.616499+0000","last_fullsized":"2024-01-27T13:59:25.616499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.056984+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T14:00:05.056984+0000","last_peered":"2024-01-27T14:00:05.056984+0000","last_clean":"2024-01-27T14:00:05.056984+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T14:00:05.056984+0000","last_undegraded":"2024-01-27T14:00:05.056984+0000","last_fullsized":"2024-01-27T14:00:05.056984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632091+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:59:55.632091+0000","last_peered":"2024-01-27T13:59:55.632091+0000","last_clean":"2024-01-27T13:59:55.632091+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:59:55.632091+0000","last_undegraded":"2024-01-27T13:59:55.632091+0000","last_fullsized":"2024-01-27T13:59:55.632091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'145","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107796+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:59:35.107796+0000","last_peered":"2024-01-27T13:59:35.107796+0000","last_clean":"2024-01-27T13:59:35.107796+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:59:35.107796+0000","last_undegraded":"2024-01-27T13:59:35.107796+0000","last_fullsized":"2024-01-27T13:59:35.107796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:25.616103+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:59:25.616103+0000","last_peered":"2024-01-27T13:59:25.616103+0000","last_clean":"2024-01-27T13:59:25.616103+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:59:25.616103+0000","last_undegraded":"2024-01-27T13:59:25.616103+0000","last_fullsized":"2024-01-27T13:59:25.616103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":11460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.003404+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T14:00:05.003404+0000","last_peered":"2024-01-27T14:00:05.003404+0000","last_clean":"2024-01-27T14:00:05.003404+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T14:00:05.003404+0000","last_undegraded":"2024-01-27T14:00:05.003404+0000","last_fullsized":"2024-01-27T14:00:05.003404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:48.616130+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:58:48.616130+0000","last_peered":"2024-01-27T13:58:48.616130+0000","last_clean":"2024-01-27T13:58:48.616130+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:58:48.616130+0000","last_undegraded":"2024-01-27T13:58:48.616130+0000","last_fullsized":"2024-01-27T13:58:48.616130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'150","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.795209+0000","last_change":"2024-01-27T13:32:51.707209+0000","last_active":"2024-01-27T13:59:30.795209+0000","last_peered":"2024-01-27T13:59:30.795209+0000","last_clean":"2024-01-27T13:59:30.795209+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T13:59:30.795209+0000","last_undegraded":"2024-01-27T13:59:30.795209+0000","last_fullsized":"2024-01-27T13:59:30.795209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:40.489268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":19231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.009681+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T14:00:05.009681+0000","last_peered":"2024-01-27T14:00:05.009681+0000","last_clean":"2024-01-27T14:00:05.009681+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T14:00:05.009681+0000","last_undegraded":"2024-01-27T14:00:05.009681+0000","last_fullsized":"2024-01-27T14:00:05.009681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.629429+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:59:55.629429+0000","last_peered":"2024-01-27T13:59:55.629429+0000","last_clean":"2024-01-27T13:59:55.629429+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:59:55.629429+0000","last_undegraded":"2024-01-27T13:59:55.629429+0000","last_fullsized":"2024-01-27T13:59:55.629429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'691","reported_seq":728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.515899+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:59:49.515899+0000","last_peered":"2024-01-27T13:59:49.515899+0000","last_clean":"2024-01-27T13:59:49.515899+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:59:49.515899+0000","last_undegraded":"2024-01-27T13:59:49.515899+0000","last_fullsized":"2024-01-27T13:59:49.515899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183916+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T14:00:05.183916+0000","last_peered":"2024-01-27T14:00:05.183916+0000","last_clean":"2024-01-27T14:00:05.183916+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T14:00:05.183916+0000","last_undegraded":"2024-01-27T14:00:05.183916+0000","last_fullsized":"2024-01-27T14:00:05.183916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'81","reported_seq":110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.209016+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:59:33.209016+0000","last_peered":"2024-01-27T13:59:33.209016+0000","last_clean":"2024-01-27T13:59:33.209016+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:59:33.209016+0000","last_undegraded":"2024-01-27T13:59:33.209016+0000","last_fullsized":"2024-01-27T13:59:33.209016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'709","reported_seq":746,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:51.895033+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:59:51.895033+0000","last_peered":"2024-01-27T13:59:51.895033+0000","last_clean":"2024-01-27T13:59:51.895033+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:59:51.895033+0000","last_undegraded":"2024-01-27T13:59:51.895033+0000","last_fullsized":"2024-01-27T13:59:51.895033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018462+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T14:00:05.018462+0000","last_peered":"2024-01-27T14:00:05.018462+0000","last_clean":"2024-01-27T14:00:05.018462+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T14:00:05.018462+0000","last_undegraded":"2024-01-27T14:00:05.018462+0000","last_fullsized":"2024-01-27T14:00:05.018462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'143","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.451919+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:59:36.451919+0000","last_peered":"2024-01-27T13:59:36.451919+0000","last_clean":"2024-01-27T13:59:36.451919+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:59:36.451919+0000","last_undegraded":"2024-01-27T13:59:36.451919+0000","last_fullsized":"2024-01-27T13:59:36.451919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'46","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082677+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T14:00:05.082677+0000","last_peered":"2024-01-27T14:00:05.082677+0000","last_clean":"2024-01-27T14:00:05.082677+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T14:00:05.082677+0000","last_undegraded":"2024-01-27T14:00:05.082677+0000","last_fullsized":"2024-01-27T14:00:05.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.075513+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T14:00:05.075513+0000","last_peered":"2024-01-27T14:00:05.075513+0000","last_clean":"2024-01-27T14:00:05.075513+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T14:00:05.075513+0000","last_undegraded":"2024-01-27T14:00:05.075513+0000","last_fullsized":"2024-01-27T14:00:05.075513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.012785+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T14:00:05.012785+0000","last_peered":"2024-01-27T14:00:05.012785+0000","last_clean":"2024-01-27T14:00:05.012785+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T14:00:05.012785+0000","last_undegraded":"2024-01-27T14:00:05.012785+0000","last_fullsized":"2024-01-27T14:00:05.012785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183244+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T14:00:05.183244+0000","last_peered":"2024-01-27T14:00:05.183244+0000","last_clean":"2024-01-27T14:00:05.183244+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T14:00:05.183244+0000","last_undegraded":"2024-01-27T14:00:05.183244+0000","last_fullsized":"2024-01-27T14:00:05.183244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'24","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015849+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T14:00:05.015849+0000","last_peered":"2024-01-27T14:00:05.015849+0000","last_clean":"2024-01-27T14:00:05.015849+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T14:00:05.015849+0000","last_undegraded":"2024-01-27T14:00:05.015849+0000","last_fullsized":"2024-01-27T14:00:05.015849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'28","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.998880+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T14:00:04.998880+0000","last_peered":"2024-01-27T14:00:04.998880+0000","last_clean":"2024-01-27T14:00:04.998880+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T14:00:04.998880+0000","last_undegraded":"2024-01-27T14:00:04.998880+0000","last_fullsized":"2024-01-27T14:00:04.998880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083694+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T14:00:05.083694+0000","last_peered":"2024-01-27T14:00:05.083694+0000","last_clean":"2024-01-27T14:00:05.083694+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T14:00:05.083694+0000","last_undegraded":"2024-01-27T14:00:05.083694+0000","last_fullsized":"2024-01-27T14:00:05.083694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015521+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T14:00:05.015521+0000","last_peered":"2024-01-27T14:00:05.015521+0000","last_clean":"2024-01-27T14:00:05.015521+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T14:00:05.015521+0000","last_undegraded":"2024-01-27T14:00:05.015521+0000","last_fullsized":"2024-01-27T14:00:05.015521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015254+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T14:00:05.015254+0000","last_peered":"2024-01-27T14:00:05.015254+0000","last_clean":"2024-01-27T14:00:05.015254+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T14:00:05.015254+0000","last_undegraded":"2024-01-27T14:00:05.015254+0000","last_fullsized":"2024-01-27T14:00:05.015254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.016145+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T14:00:05.016145+0000","last_peered":"2024-01-27T14:00:05.016145+0000","last_clean":"2024-01-27T14:00:05.016145+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T14:00:05.016145+0000","last_undegraded":"2024-01-27T14:00:05.016145+0000","last_fullsized":"2024-01-27T14:00:05.016145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.051296+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T14:00:05.051296+0000","last_peered":"2024-01-27T14:00:05.051296+0000","last_clean":"2024-01-27T14:00:05.051296+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T14:00:05.051296+0000","last_undegraded":"2024-01-27T14:00:05.051296+0000","last_fullsized":"2024-01-27T14:00:05.051296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'45","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183325+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T14:00:05.183325+0000","last_peered":"2024-01-27T14:00:05.183325+0000","last_clean":"2024-01-27T14:00:05.183325+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T14:00:05.183325+0000","last_undegraded":"2024-01-27T14:00:05.183325+0000","last_fullsized":"2024-01-27T14:00:05.183325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082845+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T14:00:05.082845+0000","last_peered":"2024-01-27T14:00:05.082845+0000","last_clean":"2024-01-27T14:00:05.082845+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T14:00:05.082845+0000","last_undegraded":"2024-01-27T14:00:05.082845+0000","last_fullsized":"2024-01-27T14:00:05.082845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080535+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T14:00:05.080535+0000","last_peered":"2024-01-27T14:00:05.080535+0000","last_clean":"2024-01-27T14:00:05.080535+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T14:00:05.080535+0000","last_undegraded":"2024-01-27T14:00:05.080535+0000","last_fullsized":"2024-01-27T14:00:05.080535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.070906+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T14:00:05.070906+0000","last_peered":"2024-01-27T14:00:05.070906+0000","last_clean":"2024-01-27T14:00:05.070906+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T14:00:05.070906+0000","last_undegraded":"2024-01-27T14:00:05.070906+0000","last_fullsized":"2024-01-27T14:00:05.070906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015738+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T14:00:05.015738+0000","last_peered":"2024-01-27T14:00:05.015738+0000","last_clean":"2024-01-27T14:00:05.015738+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T14:00:05.015738+0000","last_undegraded":"2024-01-27T14:00:05.015738+0000","last_fullsized":"2024-01-27T14:00:05.015738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'36","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018782+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T14:00:05.018782+0000","last_peered":"2024-01-27T14:00:05.018782+0000","last_clean":"2024-01-27T14:00:05.018782+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T14:00:05.018782+0000","last_undegraded":"2024-01-27T14:00:05.018782+0000","last_fullsized":"2024-01-27T14:00:05.018782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.000016+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T14:00:05.000016+0000","last_peered":"2024-01-27T14:00:05.000016+0000","last_clean":"2024-01-27T14:00:05.000016+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T14:00:05.000016+0000","last_undegraded":"2024-01-27T14:00:05.000016+0000","last_fullsized":"2024-01-27T14:00:05.000016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183664+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T14:00:05.183664+0000","last_peered":"2024-01-27T14:00:05.183664+0000","last_clean":"2024-01-27T14:00:05.183664+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T14:00:05.183664+0000","last_undegraded":"2024-01-27T14:00:05.183664+0000","last_fullsized":"2024-01-27T14:00:05.183664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013192+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T14:00:05.013192+0000","last_peered":"2024-01-27T14:00:05.013192+0000","last_clean":"2024-01-27T14:00:05.013192+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T14:00:05.013192+0000","last_undegraded":"2024-01-27T14:00:05.013192+0000","last_fullsized":"2024-01-27T14:00:05.013192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015756+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T14:00:05.015756+0000","last_peered":"2024-01-27T14:00:05.015756+0000","last_clean":"2024-01-27T14:00:05.015756+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T14:00:05.015756+0000","last_undegraded":"2024-01-27T14:00:05.015756+0000","last_fullsized":"2024-01-27T14:00:05.015756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080044+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T14:00:05.080044+0000","last_peered":"2024-01-27T14:00:05.080044+0000","last_clean":"2024-01-27T14:00:05.080044+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T14:00:05.080044+0000","last_undegraded":"2024-01-27T14:00:05.080044+0000","last_fullsized":"2024-01-27T14:00:05.080044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'44","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085310+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T14:00:05.085310+0000","last_peered":"2024-01-27T14:00:05.085310+0000","last_clean":"2024-01-27T14:00:05.085310+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T14:00:05.085310+0000","last_undegraded":"2024-01-27T14:00:05.085310+0000","last_fullsized":"2024-01-27T14:00:05.085310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'40","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.072171+0000","last_change":"2024-01-27T13:32:51.706601+0000","last_active":"2024-01-27T14:00:05.072171+0000","last_peered":"2024-01-27T14:00:05.072171+0000","last_clean":"2024-01-27T14:00:05.072171+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T14:00:05.072171+0000","last_undegraded":"2024-01-27T14:00:05.072171+0000","last_fullsized":"2024-01-27T14:00:05.072171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'30","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015304+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T14:00:05.015304+0000","last_peered":"2024-01-27T14:00:05.015304+0000","last_clean":"2024-01-27T14:00:05.015304+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T14:00:05.015304+0000","last_undegraded":"2024-01-27T14:00:05.015304+0000","last_fullsized":"2024-01-27T14:00:05.015304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.076729+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T14:00:05.076729+0000","last_peered":"2024-01-27T14:00:05.076729+0000","last_clean":"2024-01-27T14:00:05.076729+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T14:00:05.076729+0000","last_undegraded":"2024-01-27T14:00:05.076729+0000","last_fullsized":"2024-01-27T14:00:05.076729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017942+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T14:00:05.017942+0000","last_peered":"2024-01-27T14:00:05.017942+0000","last_clean":"2024-01-27T14:00:05.017942+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T14:00:05.017942+0000","last_undegraded":"2024-01-27T14:00:05.017942+0000","last_fullsized":"2024-01-27T14:00:05.017942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082979+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T14:00:05.082979+0000","last_peered":"2024-01-27T14:00:05.082979+0000","last_clean":"2024-01-27T14:00:05.082979+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T14:00:05.082979+0000","last_undegraded":"2024-01-27T14:00:05.082979+0000","last_fullsized":"2024-01-27T14:00:05.082979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059907+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T14:00:05.059907+0000","last_peered":"2024-01-27T14:00:05.059907+0000","last_clean":"2024-01-27T14:00:05.059907+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T14:00:05.059907+0000","last_undegraded":"2024-01-27T14:00:05.059907+0000","last_fullsized":"2024-01-27T14:00:05.059907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185199+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T14:00:05.185199+0000","last_peered":"2024-01-27T14:00:05.185199+0000","last_clean":"2024-01-27T14:00:05.185199+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T14:00:05.185199+0000","last_undegraded":"2024-01-27T14:00:05.185199+0000","last_fullsized":"2024-01-27T14:00:05.185199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.997850+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T14:00:04.997850+0000","last_peered":"2024-01-27T14:00:04.997850+0000","last_clean":"2024-01-27T14:00:04.997850+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T14:00:04.997850+0000","last_undegraded":"2024-01-27T14:00:04.997850+0000","last_fullsized":"2024-01-27T14:00:04.997850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083482+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T14:00:05.083482+0000","last_peered":"2024-01-27T14:00:05.083482+0000","last_clean":"2024-01-27T14:00:05.083482+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T14:00:05.083482+0000","last_undegraded":"2024-01-27T14:00:05.083482+0000","last_fullsized":"2024-01-27T14:00:05.083482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3814,"num_write_kb":297749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4253,"ondisk_log_size":4253,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2213,"ondisk_log_size":2213,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37841560,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":8392,"num_write_kb":41932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":75683120,"data_compressed":6983726,"data_compressed_allocated":10756096,"data_compressed_original":34791424,"omap_allocated":0,"internal_metadata":0},"log_size":7946,"ondisk_log_size":7946,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58756,"kb_used_data":9532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313084,"statfs":{"total":96636764160,"available":96576598016,"internally_reserved":0,"allocated":9760768,"data_stored":12897988,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.19600000000000001},"max":{"1min":0.439,"5min":0.48499999999999999,"15min":0.62},"last":0.251}]},{"osd":1,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.314},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56799999999999995,"15min":0.622},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.65300000000000002,"5min":0.82399999999999995,"15min":0.879},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":483328,"data_stored":314404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29799999999999999,"15min":0.30599999999999999},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.42799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.442,"5min":0.497,"15min":0.61699999999999999},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22500000000000001},"max":{"1min":0.45300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46899999999999997,"5min":0.60399999999999998,"15min":0.63},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.223,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.59699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.376,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.224},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.79500000000000004},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29699999999999999},"max":{"1min":0.57799999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.79100000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.874},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.83199999999999996,"15min":0.88100000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.373,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":0.84899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.52400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42148,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329692,"statfs":{"total":96636764160,"available":96593604608,"internally_reserved":0,"allocated":2715648,"data_stored":4203962,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.317,"15min":0.314},"min":{"1min":0.191,"5min":0.191,"15min":0.19},"max":{"1min":0.46500000000000002,"5min":0.47899999999999998,"15min":0.51400000000000001},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.42499999999999999,"5min":0.54400000000000004,"15min":0.63200000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.317,"15min":0.318},"min":{"1min":0.221,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.72899999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.41999999999999998,"5min":0.51700000000000002,"15min":0.622},"last":0.315}]},{"osd":3,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.63500000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":1.0149999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.86899999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34599999999999997},"max":{"1min":0.66300000000000003,"5min":0.84299999999999997,"15min":0.871},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":1,"15min":1},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57999999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542486,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78296,"kb_used_data":16592,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293544,"statfs":{"total":96636764160,"available":96556589056,"internally_reserved":0,"allocated":16990208,"data_stored":25766272,"data_compressed":2458257,"data_compressed_allocated":3723264,"data_compressed_original":12673024,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.69999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.309},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72999999999999998},"last":0.68500000000000005}]},{"osd":1,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.71599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.68500000000000005},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.70199999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.70499999999999996}]},{"osd":3,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71799999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.19900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81299999999999994},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.23300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.85099999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.26000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.82699999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.28799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73384,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94298456,"statfs":{"total":96636764160,"available":96561618944,"internally_reserved":0,"allocated":11960320,"data_stored":16894162,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.438,"15min":0.433},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.84099999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.873},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.68200000000000005},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":0.66900000000000004,"15min":0.80200000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.89300000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.59999999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.91400000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.83899999999999997},"last":0.40699999999999997}]},{"osd":5,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.61899999999999999,"5min":0.68700000000000006,"15min":0.83599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.93500000000000005},"last":0.35999999999999999}]},{"osd":7,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.25900000000000001},"max":{"1min":0.65200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.81899999999999995,"15min":0.89500000000000002},"last":0.53700000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542485,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46000000000000002,"15min":0.434},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.20100000000000001},"max":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67300000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23799999999999999},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":0.504}]},{"osd":1,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57499999999999996,"5min":0.66300000000000003,"15min":0.76300000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.44400000000000001},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":1.101,"15min":1.101},"last":0.439},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70799999999999996},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.70099999999999996,"15min":0.71599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.76300000000000001},"last":0.45100000000000001}]},{"osd":6,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68999999999999995,"5min":0.754,"15min":0.76300000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.79100000000000004},"last":0.46500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542486,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41272,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330568,"statfs":{"total":96636764160,"available":96594501632,"internally_reserved":0,"allocated":6078464,"data_stored":8505008,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.72099999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.20699999999999999},"max":{"1min":0.65200000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66700000000000004},"last":0.503},{"interface":"front","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32400000000000001,"15min":0.222},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.83599999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.46500000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":0.872},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.78900000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.80900000000000005},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.65600000000000003,"5min":0.748,"15min":0.748},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.374}]},{"osd":6,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.85599999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437}]},{"osd":7,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":0.754,"15min":0.877},"last":0.40600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":5688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":5824512,"data_stored":9095888,"data_compressed":837553,"data_compressed_allocated":1253376,"data_compressed_original":4706304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.188,"15min":0.17899999999999999},"max":{"1min":0.41299999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.252},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.308},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.437,"5min":0.52600000000000002,"15min":0.59799999999999998},"last":0.42199999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.27300000000000002,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":0.502,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.252,"5min":0.246,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.63600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.23200000000000001},"max":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.78600000000000003},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33600000000000002,"15min":0.27800000000000002},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.91600000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.377,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.76500000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79300000000000004},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71999999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":8389246,"data_compressed":804970,"data_compressed_allocated":1208320,"data_compressed_original":4132864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2433024,"data_stored":4087688,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":198130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9478144,"data_stored":12781714,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8388734,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11677696,"data_stored":16777888,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16642048,"data_stored":25059630,"data_compressed":2425674,"data_compressed_allocated":3678208,"data_compressed_original":12099584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:00:11.721 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:00:11.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.868+0000 7f9ef4b3e640 1 Processor -- start 2024-01-27T14:00:11.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.868+0000 7f9ef4b3e640 1 -- start start 2024-01-27T14:00:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.869+0000 7f9ef4b3e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ef0153a50 0x7f9ef00c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.869+0000 7f9ef4b3e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ef0159950 0x7f9ef0159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.869+0000 7f9ef4b3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00c9480 con 0x7f9ef00c77d0 2024-01-27T14:00:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.869+0000 7f9ef4b3e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00c9740 con 0x7f9ef0159950 2024-01-27T14:00:11.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.869+0000 7f9ef4b3e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef015a2c0 con 0x7f9ef0153a50 2024-01-27T14:00:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.870+0000 7f9eeed9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ef0159950 0x7f9ef0159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.870+0000 7f9eee59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ef0153a50 0x7f9ef00c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.870+0000 7f9eeed9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f9ef0159950 0x7f9ef0159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37080/0 (socket says 172.21.15.46:37080) 2024-01-27T14:00:11.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.870+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1015410552 learned_addr learned my addr 172.21.15.46:0/1015410552 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:11.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.872+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1015410552 >> v2:172.21.15.78:3300/0 conn(0x7f9ef0153a50 msgr2=0x7f9ef00c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.872+0000 7f9eeed9d640 1 --2- 172.21.15.46:0/1015410552 >> v2:172.21.15.78:3300/0 conn(0x7f9ef0153a50 0x7f9ef00c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.872+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1015410552 >> v1:172.21.15.78:6789/0 conn(0x7f9ef00c77d0 legacy=0x7f9ef00c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:11.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.872+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1015410552 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef006bfb0 con 0x7f9ef0159950 2024-01-27T14:00:11.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.874+0000 7f9eeed9d640 1 --2- 172.21.15.46:0/1015410552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef0159d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00718d0 tx=0x7f9ee802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ece0e6b58f18ed3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:11.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9eed59a640 1 -- 172.21.15.46:0/1015410552 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8030860 con 0x7f9ef0159950 2024-01-27T14:00:11.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9eed59a640 1 -- 172.21.15.46:0/1015410552 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80309c0 con 0x7f9ef0159950 2024-01-27T14:00:11.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9eed59a640 1 -- 172.21.15.46:0/1015410552 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8030d50 con 0x7f9ef0159950 2024-01-27T14:00:11.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1015410552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 msgr2=0x7f9ef0159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1015410552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef0159d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00718d0 tx=0x7f9ee802b9a0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1015410552 shutdown_connections 2024-01-27T14:00:11.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1015410552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef0159d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1015410552 >> v2:172.21.15.78:3300/0 conn(0x7f9ef0153a50 0x7f9ef00c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.878+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1015410552 >> 172.21.15.46:0/1015410552 conn(0x7f9ef006efe0 msgr2=0x7f9ef006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.879+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1015410552 shutdown_connections 2024-01-27T14:00:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.879+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1015410552 wait complete. 2024-01-27T14:00:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.880+0000 7f9ef4b3e640 1 Processor -- start 2024-01-27T14:00:11.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.880+0000 7f9ef4b3e640 1 -- start start 2024-01-27T14:00:11.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9ef4b3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef00c77d0 0x7f9ef01f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9ef4b3e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef0153a50 0x7f9ef00cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9ef4b3e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9ef4b3e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c7520 con 0x7f9ef0159950 2024-01-27T14:00:11.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9ef4b3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01ef350 con 0x7f9ef00c77d0 2024-01-27T14:00:11.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9ef4b3e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef01f3810 con 0x7f9ef0153a50 2024-01-27T14:00:11.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9eeed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9eeed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef00c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37084/0 (socket says 172.21.15.46:37084) 2024-01-27T14:00:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1702924247 learned_addr learned my addr 172.21.15.46:0/1702924247 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9eee59c640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef00c77d0 0x7f9ef01f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.881+0000 7f9eedd9b640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef0153a50 0x7f9ef00cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.885+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef0153a50 msgr2=0x7f9ef00cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.885+0000 7f9eeed9d640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef0153a50 0x7f9ef00cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.885+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef00c77d0 msgr2=0x7f9ef01f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:11.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.885+0000 7f9eeed9d640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef00c77d0 0x7f9ef01f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:11.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.885+0000 7f9eeed9d640 1 -- 172.21.15.46:0/1702924247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80094d0 con 0x7f9ef0159950 2024-01-27T14:00:11.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.887+0000 7f9eeed9d640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef00c6b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ee802b9e0 tx=0x7f9ee8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.891+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8039a90 con 0x7f9ef0159950 2024-01-27T14:00:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.891+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee8039bf0 con 0x7f9ef0159950 2024-01-27T14:00:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.891+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80433f0 con 0x7f9ef0159950 2024-01-27T14:00:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.891+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef01ef560 con 0x7f9ef0159950 2024-01-27T14:00:11.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.891+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef01efb20 con 0x7f9ef0159950 2024-01-27T14:00:11.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.892+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef0074410 con 0x7f9ef0159950 2024-01-27T14:00:11.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.910+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9ee804c3b0 con 0x7f9ef0159950 2024-01-27T14:00:11.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.911+0000 7f9edeffd640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9ed006af20 0x7f9ed006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:11.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.911+0000 7f9eee59c640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9ed006af20 0x7f9ed006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:11.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.911+0000 7f9eee59c640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9ed006af20 0x7f9ed006d3e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00113e0 tx=0x7f9ee000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:11.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:11.915+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ee807afc0 con 0x7f9ef0159950 2024-01-27T14:00:12.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.165+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f9ee8077300 con 0x7f9ef0159950 2024-01-27T14:00:12.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.348+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ef006c850 con 0x7f9ed006af20 2024-01-27T14:00:12.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.357+0000 7f9edeffd640 1 -- 172.21.15.46:0/1702924247 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371403 (secure 0 0 0) 0x7f9ee000f040 con 0x7f9ed006af20 2024-01-27T14:00:12.348 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:12.350 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:00:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.360+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9ed006af20 msgr2=0x7f9ed006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.360+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9ed006af20 0x7f9ed006d3e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00113e0 tx=0x7f9ee000b040 comp rx=0 tx=0).stop 2024-01-27T14:00:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.360+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 msgr2=0x7f9ef00c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.360+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef00c6b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ee802b9e0 tx=0x7f9ee8004730 comp rx=0 tx=0).stop 2024-01-27T14:00:12.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 shutdown_connections 2024-01-27T14:00:12.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9ed006af20 0x7f9ed006d3e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef0159950 0x7f9ef00c6b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9ef0153a50 0x7f9ef00cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 --2- 172.21.15.46:0/1702924247 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef00c77d0 0x7f9ef01f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 >> 172.21.15.46:0/1702924247 conn(0x7f9ef006efe0 msgr2=0x7f9ef00c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 shutdown_connections 2024-01-27T14:00:12.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.361+0000 7f9ef4b3e640 1 -- 172.21.15.46:0/1702924247 wait complete. 2024-01-27T14:00:12.359 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":869,"stamp":"2024-01-27T14:00:11.948735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38431928,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1007,"num_read_kb":1043,"num_write":12365,"num_write_kb":342097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14529,"ondisk_log_size":14529,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397984,"kb_used_data":52832,"kb_used_omap":12,"kb_used_meta":345075,"kb_avail":754576736,"statfs":{"total":773094113280,"available":772686577664,"internally_reserved":0,"allocated":54099968,"data_stored":77794048,"data_compressed":7048892,"data_compressed_allocated":10846208,"data_compressed_original":35938304,"omap_allocated":12752,"internal_metadata":353357360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14522,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003084"},"pg_stats":[{"pgid":"2.1f","version":"27'623","reported_seq":662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:17.541406+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:59:17.541406+0000","last_peered":"2024-01-27T13:59:17.541406+0000","last_clean":"2024-01-27T13:59:17.541406+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:59:17.541406+0000","last_undegraded":"2024-01-27T13:59:17.541406+0000","last_fullsized":"2024-01-27T13:59:17.541406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'26","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010332+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T14:00:05.010332+0000","last_peered":"2024-01-27T14:00:05.010332+0000","last_clean":"2024-01-27T14:00:05.010332+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T14:00:05.010332+0000","last_undegraded":"2024-01-27T14:00:05.010332+0000","last_fullsized":"2024-01-27T14:00:05.010332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'150","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.965054+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:59:30.965054+0000","last_peered":"2024-01-27T13:59:30.965054+0000","last_clean":"2024-01-27T13:59:30.965054+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:59:30.965054+0000","last_undegraded":"2024-01-27T13:59:30.965054+0000","last_fullsized":"2024-01-27T13:59:30.965054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'716","reported_seq":755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.518984+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:59:49.518984+0000","last_peered":"2024-01-27T13:59:49.518984+0000","last_clean":"2024-01-27T13:59:49.518984+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:59:49.518984+0000","last_undegraded":"2024-01-27T13:59:49.518984+0000","last_fullsized":"2024-01-27T13:59:49.518984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185102+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T14:00:05.185102+0000","last_peered":"2024-01-27T14:00:05.185102+0000","last_clean":"2024-01-27T14:00:05.185102+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T14:00:05.185102+0000","last_undegraded":"2024-01-27T14:00:05.185102+0000","last_fullsized":"2024-01-27T14:00:05.185102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'132","reported_seq":161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787902+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:59:30.787902+0000","last_peered":"2024-01-27T13:59:30.787902+0000","last_clean":"2024-01-27T13:59:30.787902+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:59:30.787902+0000","last_undegraded":"2024-01-27T13:59:30.787902+0000","last_fullsized":"2024-01-27T13:59:30.787902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1388","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.618629+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:59:53.618629+0000","last_peered":"2024-01-27T13:59:53.618629+0000","last_clean":"2024-01-27T13:59:53.618629+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:59:53.618629+0000","last_undegraded":"2024-01-27T13:59:53.618629+0000","last_fullsized":"2024-01-27T13:59:53.618629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059839+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T14:00:05.059839+0000","last_peered":"2024-01-27T14:00:05.059839+0000","last_clean":"2024-01-27T14:00:05.059839+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T14:00:05.059839+0000","last_undegraded":"2024-01-27T14:00:05.059839+0000","last_fullsized":"2024-01-27T14:00:05.059839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'121","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.998050+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:59:33.998050+0000","last_peered":"2024-01-27T13:59:33.998050+0000","last_clean":"2024-01-27T13:59:33.998050+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:59:33.998050+0000","last_undegraded":"2024-01-27T13:59:33.998050+0000","last_fullsized":"2024-01-27T13:59:33.998050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:45.339471+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:59:45.339471+0000","last_peered":"2024-01-27T13:59:45.339471+0000","last_clean":"2024-01-27T13:59:45.339471+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:59:45.339471+0000","last_undegraded":"2024-01-27T13:59:45.339471+0000","last_fullsized":"2024-01-27T13:59:45.339471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.021532+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T14:00:05.021532+0000","last_peered":"2024-01-27T14:00:05.021532+0000","last_clean":"2024-01-27T14:00:05.021532+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T14:00:05.021532+0000","last_undegraded":"2024-01-27T14:00:05.021532+0000","last_fullsized":"2024-01-27T14:00:05.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'126","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.124660+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:59:32.124660+0000","last_peered":"2024-01-27T13:59:32.124660+0000","last_clean":"2024-01-27T13:59:32.124660+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:59:32.124660+0000","last_undegraded":"2024-01-27T13:59:32.124660+0000","last_fullsized":"2024-01-27T13:59:32.124660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085606+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T14:00:05.085606+0000","last_peered":"2024-01-27T14:00:05.085606+0000","last_clean":"2024-01-27T14:00:05.085606+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T14:00:05.085606+0000","last_undegraded":"2024-01-27T14:00:05.085606+0000","last_fullsized":"2024-01-27T14:00:05.085606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'617","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617302+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:59:53.617302+0000","last_peered":"2024-01-27T13:59:53.617302+0000","last_clean":"2024-01-27T13:59:53.617302+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:59:53.617302+0000","last_undegraded":"2024-01-27T13:59:53.617302+0000","last_fullsized":"2024-01-27T13:59:53.617302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'102","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:27.902717+0000","last_change":"2024-01-27T13:32:51.707357+0000","last_active":"2024-01-27T13:59:27.902717+0000","last_peered":"2024-01-27T13:59:27.902717+0000","last_clean":"2024-01-27T13:59:27.902717+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T13:59:27.902717+0000","last_undegraded":"2024-01-27T13:59:27.902717+0000","last_fullsized":"2024-01-27T13:59:27.902717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:36:27.470407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.007850+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T14:00:05.007850+0000","last_peered":"2024-01-27T14:00:05.007850+0000","last_clean":"2024-01-27T14:00:05.007850+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T14:00:05.007850+0000","last_undegraded":"2024-01-27T14:00:05.007850+0000","last_fullsized":"2024-01-27T14:00:05.007850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:19.587073+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:58:19.587073+0000","last_peered":"2024-01-27T13:58:19.587073+0000","last_clean":"2024-01-27T13:58:19.587073+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:58:19.587073+0000","last_undegraded":"2024-01-27T13:58:19.587073+0000","last_fullsized":"2024-01-27T13:58:19.587073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'162","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787700+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:59:30.787700+0000","last_peered":"2024-01-27T13:59:30.787700+0000","last_clean":"2024-01-27T13:59:30.787700+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:59:30.787700+0000","last_undegraded":"2024-01-27T13:59:30.787700+0000","last_fullsized":"2024-01-27T13:59:30.787700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":10103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'33","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067491+0000","last_change":"2024-01-27T13:32:51.715993+0000","last_active":"2024-01-27T14:00:05.067491+0000","last_peered":"2024-01-27T14:00:05.067491+0000","last_clean":"2024-01-27T14:00:05.067491+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T14:00:05.067491+0000","last_undegraded":"2024-01-27T14:00:05.067491+0000","last_fullsized":"2024-01-27T14:00:05.067491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.481531+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:59:47.481531+0000","last_peered":"2024-01-27T13:59:47.481531+0000","last_clean":"2024-01-27T13:59:47.481531+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:59:47.481531+0000","last_undegraded":"2024-01-27T13:59:47.481531+0000","last_fullsized":"2024-01-27T13:59:47.481531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'135","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.546165+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:59:32.546165+0000","last_peered":"2024-01-27T13:59:32.546165+0000","last_clean":"2024-01-27T13:59:32.546165+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:59:32.546165+0000","last_undegraded":"2024-01-27T13:59:32.546165+0000","last_fullsized":"2024-01-27T13:59:32.546165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.532444+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:59:32.532444+0000","last_peered":"2024-01-27T13:59:32.532444+0000","last_clean":"2024-01-27T13:59:32.532444+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:59:32.532444+0000","last_undegraded":"2024-01-27T13:59:32.532444+0000","last_fullsized":"2024-01-27T13:59:32.532444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617100+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:59:53.617100+0000","last_peered":"2024-01-27T13:59:53.617100+0000","last_clean":"2024-01-27T13:59:53.617100+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:59:53.617100+0000","last_undegraded":"2024-01-27T13:59:53.617100+0000","last_fullsized":"2024-01-27T13:59:53.617100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'105","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217803+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:59:33.217803+0000","last_peered":"2024-01-27T13:59:33.217803+0000","last_clean":"2024-01-27T13:59:33.217803+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:59:33.217803+0000","last_undegraded":"2024-01-27T13:59:33.217803+0000","last_fullsized":"2024-01-27T13:59:33.217803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":9310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183310+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T14:00:05.183310+0000","last_peered":"2024-01-27T14:00:05.183310+0000","last_clean":"2024-01-27T14:00:05.183310+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T14:00:05.183310+0000","last_undegraded":"2024-01-27T14:00:05.183310+0000","last_fullsized":"2024-01-27T14:00:05.183310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632858+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:59:55.632858+0000","last_peered":"2024-01-27T13:59:55.632858+0000","last_clean":"2024-01-27T13:59:55.632858+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:59:55.632858+0000","last_undegraded":"2024-01-27T13:59:55.632858+0000","last_fullsized":"2024-01-27T13:59:55.632858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'127","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.215260+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:59:33.215260+0000","last_peered":"2024-01-27T13:59:33.215260+0000","last_clean":"2024-01-27T13:59:33.215260+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:59:33.215260+0000","last_undegraded":"2024-01-27T13:59:33.215260+0000","last_fullsized":"2024-01-27T13:59:33.215260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":6403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015387+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T14:00:05.015387+0000","last_peered":"2024-01-27T14:00:05.015387+0000","last_clean":"2024-01-27T14:00:05.015387+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T14:00:05.015387+0000","last_undegraded":"2024-01-27T14:00:05.015387+0000","last_fullsized":"2024-01-27T14:00:05.015387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'309","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.629384+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:59:58.629384+0000","last_peered":"2024-01-27T13:59:58.629384+0000","last_clean":"2024-01-27T13:59:58.629384+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:59:58.629384+0000","last_undegraded":"2024-01-27T13:59:58.629384+0000","last_fullsized":"2024-01-27T13:59:58.629384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'143","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.047231+0000","last_change":"2024-01-27T13:32:51.674638+0000","last_active":"2024-01-27T13:59:35.047231+0000","last_peered":"2024-01-27T13:59:35.047231+0000","last_clean":"2024-01-27T13:59:35.047231+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T13:59:35.047231+0000","last_undegraded":"2024-01-27T13:59:35.047231+0000","last_fullsized":"2024-01-27T13:59:35.047231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:38.395479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999864+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T14:00:04.999864+0000","last_peered":"2024-01-27T14:00:04.999864+0000","last_clean":"2024-01-27T14:00:04.999864+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T14:00:04.999864+0000","last_undegraded":"2024-01-27T14:00:04.999864+0000","last_fullsized":"2024-01-27T14:00:04.999864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:43.240701+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:59:43.240701+0000","last_peered":"2024-01-27T13:59:43.240701+0000","last_clean":"2024-01-27T13:59:43.240701+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:59:43.240701+0000","last_undegraded":"2024-01-27T13:59:43.240701+0000","last_fullsized":"2024-01-27T13:59:43.240701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'116","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217955+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:59:33.217955+0000","last_peered":"2024-01-27T13:59:33.217955+0000","last_clean":"2024-01-27T13:59:33.217955+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:59:33.217955+0000","last_undegraded":"2024-01-27T13:59:33.217955+0000","last_fullsized":"2024-01-27T13:59:33.217955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017991+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T14:00:05.017991+0000","last_peered":"2024-01-27T14:00:05.017991+0000","last_clean":"2024-01-27T14:00:05.017991+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T14:00:05.017991+0000","last_undegraded":"2024-01-27T14:00:05.017991+0000","last_fullsized":"2024-01-27T14:00:05.017991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:50.528116+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:59:50.528116+0000","last_peered":"2024-01-27T13:59:50.528116+0000","last_clean":"2024-01-27T13:59:50.528116+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:59:50.528116+0000","last_undegraded":"2024-01-27T13:59:50.528116+0000","last_fullsized":"2024-01-27T13:59:50.528116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'170","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.545398+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:59:32.545398+0000","last_peered":"2024-01-27T13:59:32.545398+0000","last_clean":"2024-01-27T13:59:32.545398+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:59:32.545398+0000","last_undegraded":"2024-01-27T13:59:32.545398+0000","last_fullsized":"2024-01-27T13:59:32.545398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010376+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T14:00:05.010376+0000","last_peered":"2024-01-27T14:00:05.010376+0000","last_clean":"2024-01-27T14:00:05.010376+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T14:00:05.010376+0000","last_undegraded":"2024-01-27T14:00:05.010376+0000","last_fullsized":"2024-01-27T14:00:05.010376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.205445+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:59:42.205445+0000","last_peered":"2024-01-27T13:59:42.205445+0000","last_clean":"2024-01-27T13:59:42.205445+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:59:42.205445+0000","last_undegraded":"2024-01-27T13:59:42.205445+0000","last_fullsized":"2024-01-27T13:59:42.205445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'103","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.218046+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:59:33.218046+0000","last_peered":"2024-01-27T13:59:33.218046+0000","last_clean":"2024-01-27T13:59:33.218046+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:59:33.218046+0000","last_undegraded":"2024-01-27T13:59:33.218046+0000","last_fullsized":"2024-01-27T13:59:33.218046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999823+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T14:00:04.999823+0000","last_peered":"2024-01-27T14:00:04.999823+0000","last_clean":"2024-01-27T14:00:04.999823+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T14:00:04.999823+0000","last_undegraded":"2024-01-27T14:00:04.999823+0000","last_fullsized":"2024-01-27T14:00:04.999823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'896","reported_seq":1826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:00.617248+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T14:00:00.617248+0000","last_peered":"2024-01-27T14:00:00.617248+0000","last_clean":"2024-01-27T14:00:00.617248+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T14:00:00.617248+0000","last_undegraded":"2024-01-27T14:00:00.617248+0000","last_fullsized":"2024-01-27T14:00:00.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198130,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":891,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'141","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.444760+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:59:36.444760+0000","last_peered":"2024-01-27T13:59:36.444760+0000","last_clean":"2024-01-27T13:59:36.444760+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:59:36.444760+0000","last_undegraded":"2024-01-27T13:59:36.444760+0000","last_fullsized":"2024-01-27T13:59:36.444760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":10872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183662+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T14:00:05.183662+0000","last_peered":"2024-01-27T14:00:05.183662+0000","last_clean":"2024-01-27T14:00:05.183662+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T14:00:05.183662+0000","last_undegraded":"2024-01-27T14:00:05.183662+0000","last_fullsized":"2024-01-27T14:00:05.183662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'433","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.819081+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T14:00:04.819081+0000","last_peered":"2024-01-27T14:00:04.819081+0000","last_clean":"2024-01-27T14:00:04.819081+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T14:00:04.819081+0000","last_undegraded":"2024-01-27T14:00:04.819081+0000","last_fullsized":"2024-01-27T14:00:04.819081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087528,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'130","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.997593+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:59:33.997593+0000","last_peered":"2024-01-27T13:59:33.997593+0000","last_clean":"2024-01-27T13:59:33.997593+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:59:33.997593+0000","last_undegraded":"2024-01-27T13:59:33.997593+0000","last_fullsized":"2024-01-27T13:59:33.997593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":9704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013424+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T14:00:05.013424+0000","last_peered":"2024-01-27T14:00:05.013424+0000","last_clean":"2024-01-27T14:00:05.013424+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T14:00:05.013424+0000","last_undegraded":"2024-01-27T14:00:05.013424+0000","last_fullsized":"2024-01-27T14:00:05.013424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.520681+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:59:49.520681+0000","last_peered":"2024-01-27T13:59:49.520681+0000","last_clean":"2024-01-27T13:59:49.520681+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:59:49.520681+0000","last_undegraded":"2024-01-27T13:59:49.520681+0000","last_fullsized":"2024-01-27T13:59:49.520681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:08.571285+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:58:08.571285+0000","last_peered":"2024-01-27T13:58:08.571285+0000","last_clean":"2024-01-27T13:58:08.571285+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:58:08.571285+0000","last_undegraded":"2024-01-27T13:58:08.571285+0000","last_fullsized":"2024-01-27T13:58:08.571285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'154","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.219333+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:59:33.219333+0000","last_peered":"2024-01-27T13:59:33.219333+0000","last_clean":"2024-01-27T13:59:33.219333+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:59:33.219333+0000","last_undegraded":"2024-01-27T13:59:33.219333+0000","last_fullsized":"2024-01-27T13:59:33.219333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'32","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.098651+0000","last_change":"2024-01-27T13:32:51.718659+0000","last_active":"2024-01-27T14:00:05.098651+0000","last_peered":"2024-01-27T14:00:05.098651+0000","last_clean":"2024-01-27T14:00:05.098651+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T14:00:05.098651+0000","last_undegraded":"2024-01-27T14:00:05.098651+0000","last_fullsized":"2024-01-27T14:00:05.098651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:10:31.041312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:14.547664+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:59:14.547664+0000","last_peered":"2024-01-27T13:59:14.547664+0000","last_clean":"2024-01-27T13:59:14.547664+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:59:14.547664+0000","last_undegraded":"2024-01-27T13:59:14.547664+0000","last_fullsized":"2024-01-27T13:59:14.547664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'132","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:23.537428+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:59:23.537428+0000","last_peered":"2024-01-27T13:59:23.537428+0000","last_clean":"2024-01-27T13:59:23.537428+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:59:23.537428+0000","last_undegraded":"2024-01-27T13:59:23.537428+0000","last_fullsized":"2024-01-27T13:59:23.537428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":6638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'36","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067694+0000","last_change":"2024-01-27T13:32:51.673578+0000","last_active":"2024-01-27T14:00:05.067694+0000","last_peered":"2024-01-27T14:00:05.067694+0000","last_clean":"2024-01-27T14:00:05.067694+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T14:00:05.067694+0000","last_undegraded":"2024-01-27T14:00:05.067694+0000","last_fullsized":"2024-01-27T14:00:05.067694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:14.591258+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:59:14.591258+0000","last_peered":"2024-01-27T13:59:14.591258+0000","last_clean":"2024-01-27T13:59:14.591258+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:59:14.591258+0000","last_undegraded":"2024-01-27T13:59:14.591258+0000","last_fullsized":"2024-01-27T13:59:14.591258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'178","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100045+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:59:35.100045+0000","last_peered":"2024-01-27T13:59:35.100045+0000","last_clean":"2024-01-27T13:59:35.100045+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:59:35.100045+0000","last_undegraded":"2024-01-27T13:59:35.100045+0000","last_fullsized":"2024-01-27T13:59:35.100045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":15130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085883+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T14:00:05.085883+0000","last_peered":"2024-01-27T14:00:05.085883+0000","last_clean":"2024-01-27T14:00:05.085883+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T14:00:05.085883+0000","last_undegraded":"2024-01-27T14:00:05.085883+0000","last_fullsized":"2024-01-27T14:00:05.085883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.207807+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:59:42.207807+0000","last_peered":"2024-01-27T13:59:42.207807+0000","last_clean":"2024-01-27T13:59:42.207807+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:59:42.207807+0000","last_undegraded":"2024-01-27T13:59:42.207807+0000","last_fullsized":"2024-01-27T13:59:42.207807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'133","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.996698+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:59:33.996698+0000","last_peered":"2024-01-27T13:59:33.996698+0000","last_clean":"2024-01-27T13:59:33.996698+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:59:33.996698+0000","last_undegraded":"2024-01-27T13:59:33.996698+0000","last_fullsized":"2024-01-27T13:59:33.996698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085515+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T14:00:05.085515+0000","last_peered":"2024-01-27T14:00:05.085515+0000","last_clean":"2024-01-27T14:00:05.085515+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T14:00:05.085515+0000","last_undegraded":"2024-01-27T14:00:05.085515+0000","last_fullsized":"2024-01-27T14:00:05.085515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:18.507104+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:59:18.507104+0000","last_peered":"2024-01-27T13:59:18.507104+0000","last_clean":"2024-01-27T13:59:18.507104+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:59:18.507104+0000","last_undegraded":"2024-01-27T13:59:18.507104+0000","last_fullsized":"2024-01-27T13:59:18.507104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'153","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.502177+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:59:32.502177+0000","last_peered":"2024-01-27T13:59:32.502177+0000","last_clean":"2024-01-27T13:59:32.502177+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:59:32.502177+0000","last_undegraded":"2024-01-27T13:59:32.502177+0000","last_fullsized":"2024-01-27T13:59:32.502177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":10566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083297+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T14:00:05.083297+0000","last_peered":"2024-01-27T14:00:05.083297+0000","last_clean":"2024-01-27T14:00:05.083297+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T14:00:05.083297+0000","last_undegraded":"2024-01-27T14:00:05.083297+0000","last_fullsized":"2024-01-27T14:00:05.083297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.746872+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:59:58.746872+0000","last_peered":"2024-01-27T13:59:58.746872+0000","last_clean":"2024-01-27T13:59:58.746872+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:59:58.746872+0000","last_undegraded":"2024-01-27T13:59:58.746872+0000","last_fullsized":"2024-01-27T13:59:58.746872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'137","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.097101+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:59:35.097101+0000","last_peered":"2024-01-27T13:59:35.097101+0000","last_clean":"2024-01-27T13:59:35.097101+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:59:35.097101+0000","last_undegraded":"2024-01-27T13:59:35.097101+0000","last_fullsized":"2024-01-27T13:59:35.097101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":8266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.073366+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T14:00:05.073366+0000","last_peered":"2024-01-27T14:00:05.073366+0000","last_clean":"2024-01-27T14:00:05.073366+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T14:00:05.073366+0000","last_undegraded":"2024-01-27T14:00:05.073366+0000","last_fullsized":"2024-01-27T14:00:05.073366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:51.881725+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:59:51.881725+0000","last_peered":"2024-01-27T13:59:51.881725+0000","last_clean":"2024-01-27T13:59:51.881725+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:59:51.881725+0000","last_undegraded":"2024-01-27T13:59:51.881725+0000","last_fullsized":"2024-01-27T13:59:51.881725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107798+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:59:35.107798+0000","last_peered":"2024-01-27T13:59:35.107798+0000","last_clean":"2024-01-27T13:59:35.107798+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:59:35.107798+0000","last_undegraded":"2024-01-27T13:59:35.107798+0000","last_fullsized":"2024-01-27T13:59:35.107798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":8731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.126365+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T14:00:05.126365+0000","last_peered":"2024-01-27T14:00:05.126365+0000","last_clean":"2024-01-27T14:00:05.126365+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T14:00:05.126365+0000","last_undegraded":"2024-01-27T14:00:05.126365+0000","last_fullsized":"2024-01-27T14:00:05.126365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.630242+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:59:55.630242+0000","last_peered":"2024-01-27T13:59:55.630242+0000","last_clean":"2024-01-27T13:59:55.630242+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:59:55.630242+0000","last_undegraded":"2024-01-27T13:59:55.630242+0000","last_fullsized":"2024-01-27T13:59:55.630242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'100","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.778713+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:59:30.778713+0000","last_peered":"2024-01-27T13:59:30.778713+0000","last_clean":"2024-01-27T13:59:30.778713+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:59:30.778713+0000","last_undegraded":"2024-01-27T13:59:30.778713+0000","last_fullsized":"2024-01-27T13:59:30.778713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183338+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T14:00:05.183338+0000","last_peered":"2024-01-27T14:00:05.183338+0000","last_clean":"2024-01-27T14:00:05.183338+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T14:00:05.183338+0000","last_undegraded":"2024-01-27T14:00:05.183338+0000","last_fullsized":"2024-01-27T14:00:05.183338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.454697+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:59:47.454697+0000","last_peered":"2024-01-27T13:59:47.454697+0000","last_clean":"2024-01-27T13:59:47.454697+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:59:47.454697+0000","last_undegraded":"2024-01-27T13:59:47.454697+0000","last_fullsized":"2024-01-27T13:59:47.454697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'140","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.108071+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:59:35.108071+0000","last_peered":"2024-01-27T13:59:35.108071+0000","last_clean":"2024-01-27T13:59:35.108071+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:59:35.108071+0000","last_undegraded":"2024-01-27T13:59:35.108071+0000","last_fullsized":"2024-01-27T13:59:35.108071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":9178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083080+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T14:00:05.083080+0000","last_peered":"2024-01-27T14:00:05.083080+0000","last_clean":"2024-01-27T14:00:05.083080+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T14:00:05.083080+0000","last_undegraded":"2024-01-27T14:00:05.083080+0000","last_fullsized":"2024-01-27T14:00:05.083080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'861","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.482095+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:59:47.482095+0000","last_peered":"2024-01-27T13:59:47.482095+0000","last_clean":"2024-01-27T13:59:47.482095+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:59:47.482095+0000","last_undegraded":"2024-01-27T13:59:47.482095+0000","last_fullsized":"2024-01-27T13:59:47.482095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":4566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'134","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100208+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:59:35.100208+0000","last_peered":"2024-01-27T13:59:35.100208+0000","last_clean":"2024-01-27T13:59:35.100208+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:59:35.100208+0000","last_undegraded":"2024-01-27T13:59:35.100208+0000","last_fullsized":"2024-01-27T13:59:35.100208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018832+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T14:00:05.018832+0000","last_peered":"2024-01-27T14:00:05.018832+0000","last_clean":"2024-01-27T14:00:05.018832+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T14:00:05.018832+0000","last_undegraded":"2024-01-27T14:00:05.018832+0000","last_fullsized":"2024-01-27T14:00:05.018832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'604","reported_seq":641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.760089+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:59:58.760089+0000","last_peered":"2024-01-27T13:59:58.760089+0000","last_clean":"2024-01-27T13:59:58.760089+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:59:58.760089+0000","last_undegraded":"2024-01-27T13:59:58.760089+0000","last_fullsized":"2024-01-27T13:59:58.760089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'142","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.103737+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:59:35.103737+0000","last_peered":"2024-01-27T13:59:35.103737+0000","last_clean":"2024-01-27T13:59:35.103737+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:59:35.103737+0000","last_undegraded":"2024-01-27T13:59:35.103737+0000","last_fullsized":"2024-01-27T13:59:35.103737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":22998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185092+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T14:00:05.185092+0000","last_peered":"2024-01-27T14:00:05.185092+0000","last_clean":"2024-01-27T14:00:05.185092+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T14:00:05.185092+0000","last_undegraded":"2024-01-27T14:00:05.185092+0000","last_fullsized":"2024-01-27T14:00:05.185092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.195625+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:59:42.195625+0000","last_peered":"2024-01-27T13:59:42.195625+0000","last_clean":"2024-01-27T13:59:42.195625+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:59:42.195625+0000","last_undegraded":"2024-01-27T13:59:42.195625+0000","last_fullsized":"2024-01-27T13:59:42.195625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'115","reported_seq":144,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:25.616499+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:59:25.616499+0000","last_peered":"2024-01-27T13:59:25.616499+0000","last_clean":"2024-01-27T13:59:25.616499+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:59:25.616499+0000","last_undegraded":"2024-01-27T13:59:25.616499+0000","last_fullsized":"2024-01-27T13:59:25.616499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.056984+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T14:00:05.056984+0000","last_peered":"2024-01-27T14:00:05.056984+0000","last_clean":"2024-01-27T14:00:05.056984+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T14:00:05.056984+0000","last_undegraded":"2024-01-27T14:00:05.056984+0000","last_fullsized":"2024-01-27T14:00:05.056984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632091+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:59:55.632091+0000","last_peered":"2024-01-27T13:59:55.632091+0000","last_clean":"2024-01-27T13:59:55.632091+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:59:55.632091+0000","last_undegraded":"2024-01-27T13:59:55.632091+0000","last_fullsized":"2024-01-27T13:59:55.632091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'145","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107796+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:59:35.107796+0000","last_peered":"2024-01-27T13:59:35.107796+0000","last_clean":"2024-01-27T13:59:35.107796+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:59:35.107796+0000","last_undegraded":"2024-01-27T13:59:35.107796+0000","last_fullsized":"2024-01-27T13:59:35.107796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:25.616103+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:59:25.616103+0000","last_peered":"2024-01-27T13:59:25.616103+0000","last_clean":"2024-01-27T13:59:25.616103+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:59:25.616103+0000","last_undegraded":"2024-01-27T13:59:25.616103+0000","last_fullsized":"2024-01-27T13:59:25.616103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":11460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.003404+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T14:00:05.003404+0000","last_peered":"2024-01-27T14:00:05.003404+0000","last_clean":"2024-01-27T14:00:05.003404+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T14:00:05.003404+0000","last_undegraded":"2024-01-27T14:00:05.003404+0000","last_fullsized":"2024-01-27T14:00:05.003404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:48.616130+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:58:48.616130+0000","last_peered":"2024-01-27T13:58:48.616130+0000","last_clean":"2024-01-27T13:58:48.616130+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:58:48.616130+0000","last_undegraded":"2024-01-27T13:58:48.616130+0000","last_fullsized":"2024-01-27T13:58:48.616130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'150","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.795209+0000","last_change":"2024-01-27T13:32:51.707209+0000","last_active":"2024-01-27T13:59:30.795209+0000","last_peered":"2024-01-27T13:59:30.795209+0000","last_clean":"2024-01-27T13:59:30.795209+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T13:59:30.795209+0000","last_undegraded":"2024-01-27T13:59:30.795209+0000","last_fullsized":"2024-01-27T13:59:30.795209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:40.489268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":19231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.009681+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T14:00:05.009681+0000","last_peered":"2024-01-27T14:00:05.009681+0000","last_clean":"2024-01-27T14:00:05.009681+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T14:00:05.009681+0000","last_undegraded":"2024-01-27T14:00:05.009681+0000","last_fullsized":"2024-01-27T14:00:05.009681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.629429+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:59:55.629429+0000","last_peered":"2024-01-27T13:59:55.629429+0000","last_clean":"2024-01-27T13:59:55.629429+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:59:55.629429+0000","last_undegraded":"2024-01-27T13:59:55.629429+0000","last_fullsized":"2024-01-27T13:59:55.629429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'691","reported_seq":728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.515899+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:59:49.515899+0000","last_peered":"2024-01-27T13:59:49.515899+0000","last_clean":"2024-01-27T13:59:49.515899+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:59:49.515899+0000","last_undegraded":"2024-01-27T13:59:49.515899+0000","last_fullsized":"2024-01-27T13:59:49.515899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183916+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T14:00:05.183916+0000","last_peered":"2024-01-27T14:00:05.183916+0000","last_clean":"2024-01-27T14:00:05.183916+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T14:00:05.183916+0000","last_undegraded":"2024-01-27T14:00:05.183916+0000","last_fullsized":"2024-01-27T14:00:05.183916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'81","reported_seq":110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.209016+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:59:33.209016+0000","last_peered":"2024-01-27T13:59:33.209016+0000","last_clean":"2024-01-27T13:59:33.209016+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:59:33.209016+0000","last_undegraded":"2024-01-27T13:59:33.209016+0000","last_fullsized":"2024-01-27T13:59:33.209016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'709","reported_seq":746,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:51.895033+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:59:51.895033+0000","last_peered":"2024-01-27T13:59:51.895033+0000","last_clean":"2024-01-27T13:59:51.895033+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:59:51.895033+0000","last_undegraded":"2024-01-27T13:59:51.895033+0000","last_fullsized":"2024-01-27T13:59:51.895033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018462+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T14:00:05.018462+0000","last_peered":"2024-01-27T14:00:05.018462+0000","last_clean":"2024-01-27T14:00:05.018462+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T14:00:05.018462+0000","last_undegraded":"2024-01-27T14:00:05.018462+0000","last_fullsized":"2024-01-27T14:00:05.018462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'143","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.451919+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:59:36.451919+0000","last_peered":"2024-01-27T13:59:36.451919+0000","last_clean":"2024-01-27T13:59:36.451919+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:59:36.451919+0000","last_undegraded":"2024-01-27T13:59:36.451919+0000","last_fullsized":"2024-01-27T13:59:36.451919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'46","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082677+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T14:00:05.082677+0000","last_peered":"2024-01-27T14:00:05.082677+0000","last_clean":"2024-01-27T14:00:05.082677+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T14:00:05.082677+0000","last_undegraded":"2024-01-27T14:00:05.082677+0000","last_fullsized":"2024-01-27T14:00:05.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.075513+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T14:00:05.075513+0000","last_peered":"2024-01-27T14:00:05.075513+0000","last_clean":"2024-01-27T14:00:05.075513+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T14:00:05.075513+0000","last_undegraded":"2024-01-27T14:00:05.075513+0000","last_fullsized":"2024-01-27T14:00:05.075513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.012785+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T14:00:05.012785+0000","last_peered":"2024-01-27T14:00:05.012785+0000","last_clean":"2024-01-27T14:00:05.012785+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T14:00:05.012785+0000","last_undegraded":"2024-01-27T14:00:05.012785+0000","last_fullsized":"2024-01-27T14:00:05.012785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183244+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T14:00:05.183244+0000","last_peered":"2024-01-27T14:00:05.183244+0000","last_clean":"2024-01-27T14:00:05.183244+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T14:00:05.183244+0000","last_undegraded":"2024-01-27T14:00:05.183244+0000","last_fullsized":"2024-01-27T14:00:05.183244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'24","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015849+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T14:00:05.015849+0000","last_peered":"2024-01-27T14:00:05.015849+0000","last_clean":"2024-01-27T14:00:05.015849+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T14:00:05.015849+0000","last_undegraded":"2024-01-27T14:00:05.015849+0000","last_fullsized":"2024-01-27T14:00:05.015849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'28","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.998880+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T14:00:04.998880+0000","last_peered":"2024-01-27T14:00:04.998880+0000","last_clean":"2024-01-27T14:00:04.998880+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T14:00:04.998880+0000","last_undegraded":"2024-01-27T14:00:04.998880+0000","last_fullsized":"2024-01-27T14:00:04.998880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083694+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T14:00:05.083694+0000","last_peered":"2024-01-27T14:00:05.083694+0000","last_clean":"2024-01-27T14:00:05.083694+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T14:00:05.083694+0000","last_undegraded":"2024-01-27T14:00:05.083694+0000","last_fullsized":"2024-01-27T14:00:05.083694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015521+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T14:00:05.015521+0000","last_peered":"2024-01-27T14:00:05.015521+0000","last_clean":"2024-01-27T14:00:05.015521+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T14:00:05.015521+0000","last_undegraded":"2024-01-27T14:00:05.015521+0000","last_fullsized":"2024-01-27T14:00:05.015521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015254+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T14:00:05.015254+0000","last_peered":"2024-01-27T14:00:05.015254+0000","last_clean":"2024-01-27T14:00:05.015254+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T14:00:05.015254+0000","last_undegraded":"2024-01-27T14:00:05.015254+0000","last_fullsized":"2024-01-27T14:00:05.015254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.016145+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T14:00:05.016145+0000","last_peered":"2024-01-27T14:00:05.016145+0000","last_clean":"2024-01-27T14:00:05.016145+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T14:00:05.016145+0000","last_undegraded":"2024-01-27T14:00:05.016145+0000","last_fullsized":"2024-01-27T14:00:05.016145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.051296+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T14:00:05.051296+0000","last_peered":"2024-01-27T14:00:05.051296+0000","last_clean":"2024-01-27T14:00:05.051296+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T14:00:05.051296+0000","last_undegraded":"2024-01-27T14:00:05.051296+0000","last_fullsized":"2024-01-27T14:00:05.051296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'45","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183325+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T14:00:05.183325+0000","last_peered":"2024-01-27T14:00:05.183325+0000","last_clean":"2024-01-27T14:00:05.183325+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T14:00:05.183325+0000","last_undegraded":"2024-01-27T14:00:05.183325+0000","last_fullsized":"2024-01-27T14:00:05.183325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082845+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T14:00:05.082845+0000","last_peered":"2024-01-27T14:00:05.082845+0000","last_clean":"2024-01-27T14:00:05.082845+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T14:00:05.082845+0000","last_undegraded":"2024-01-27T14:00:05.082845+0000","last_fullsized":"2024-01-27T14:00:05.082845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080535+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T14:00:05.080535+0000","last_peered":"2024-01-27T14:00:05.080535+0000","last_clean":"2024-01-27T14:00:05.080535+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T14:00:05.080535+0000","last_undegraded":"2024-01-27T14:00:05.080535+0000","last_fullsized":"2024-01-27T14:00:05.080535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.070906+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T14:00:05.070906+0000","last_peered":"2024-01-27T14:00:05.070906+0000","last_clean":"2024-01-27T14:00:05.070906+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T14:00:05.070906+0000","last_undegraded":"2024-01-27T14:00:05.070906+0000","last_fullsized":"2024-01-27T14:00:05.070906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015738+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T14:00:05.015738+0000","last_peered":"2024-01-27T14:00:05.015738+0000","last_clean":"2024-01-27T14:00:05.015738+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T14:00:05.015738+0000","last_undegraded":"2024-01-27T14:00:05.015738+0000","last_fullsized":"2024-01-27T14:00:05.015738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'36","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018782+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T14:00:05.018782+0000","last_peered":"2024-01-27T14:00:05.018782+0000","last_clean":"2024-01-27T14:00:05.018782+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T14:00:05.018782+0000","last_undegraded":"2024-01-27T14:00:05.018782+0000","last_fullsized":"2024-01-27T14:00:05.018782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.000016+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T14:00:05.000016+0000","last_peered":"2024-01-27T14:00:05.000016+0000","last_clean":"2024-01-27T14:00:05.000016+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T14:00:05.000016+0000","last_undegraded":"2024-01-27T14:00:05.000016+0000","last_fullsized":"2024-01-27T14:00:05.000016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183664+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T14:00:05.183664+0000","last_peered":"2024-01-27T14:00:05.183664+0000","last_clean":"2024-01-27T14:00:05.183664+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T14:00:05.183664+0000","last_undegraded":"2024-01-27T14:00:05.183664+0000","last_fullsized":"2024-01-27T14:00:05.183664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013192+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T14:00:05.013192+0000","last_peered":"2024-01-27T14:00:05.013192+0000","last_clean":"2024-01-27T14:00:05.013192+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T14:00:05.013192+0000","last_undegraded":"2024-01-27T14:00:05.013192+0000","last_fullsized":"2024-01-27T14:00:05.013192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015756+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T14:00:05.015756+0000","last_peered":"2024-01-27T14:00:05.015756+0000","last_clean":"2024-01-27T14:00:05.015756+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T14:00:05.015756+0000","last_undegraded":"2024-01-27T14:00:05.015756+0000","last_fullsized":"2024-01-27T14:00:05.015756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080044+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T14:00:05.080044+0000","last_peered":"2024-01-27T14:00:05.080044+0000","last_clean":"2024-01-27T14:00:05.080044+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T14:00:05.080044+0000","last_undegraded":"2024-01-27T14:00:05.080044+0000","last_fullsized":"2024-01-27T14:00:05.080044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'44","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085310+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T14:00:05.085310+0000","last_peered":"2024-01-27T14:00:05.085310+0000","last_clean":"2024-01-27T14:00:05.085310+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T14:00:05.085310+0000","last_undegraded":"2024-01-27T14:00:05.085310+0000","last_fullsized":"2024-01-27T14:00:05.085310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'40","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.072171+0000","last_change":"2024-01-27T13:32:51.706601+0000","last_active":"2024-01-27T14:00:05.072171+0000","last_peered":"2024-01-27T14:00:05.072171+0000","last_clean":"2024-01-27T14:00:05.072171+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T14:00:05.072171+0000","last_undegraded":"2024-01-27T14:00:05.072171+0000","last_fullsized":"2024-01-27T14:00:05.072171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'30","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015304+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T14:00:05.015304+0000","last_peered":"2024-01-27T14:00:05.015304+0000","last_clean":"2024-01-27T14:00:05.015304+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T14:00:05.015304+0000","last_undegraded":"2024-01-27T14:00:05.015304+0000","last_fullsized":"2024-01-27T14:00:05.015304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.076729+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T14:00:05.076729+0000","last_peered":"2024-01-27T14:00:05.076729+0000","last_clean":"2024-01-27T14:00:05.076729+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T14:00:05.076729+0000","last_undegraded":"2024-01-27T14:00:05.076729+0000","last_fullsized":"2024-01-27T14:00:05.076729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017942+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T14:00:05.017942+0000","last_peered":"2024-01-27T14:00:05.017942+0000","last_clean":"2024-01-27T14:00:05.017942+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T14:00:05.017942+0000","last_undegraded":"2024-01-27T14:00:05.017942+0000","last_fullsized":"2024-01-27T14:00:05.017942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082979+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T14:00:05.082979+0000","last_peered":"2024-01-27T14:00:05.082979+0000","last_clean":"2024-01-27T14:00:05.082979+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T14:00:05.082979+0000","last_undegraded":"2024-01-27T14:00:05.082979+0000","last_fullsized":"2024-01-27T14:00:05.082979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059907+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T14:00:05.059907+0000","last_peered":"2024-01-27T14:00:05.059907+0000","last_clean":"2024-01-27T14:00:05.059907+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T14:00:05.059907+0000","last_undegraded":"2024-01-27T14:00:05.059907+0000","last_fullsized":"2024-01-27T14:00:05.059907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185199+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T14:00:05.185199+0000","last_peered":"2024-01-27T14:00:05.185199+0000","last_clean":"2024-01-27T14:00:05.185199+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T14:00:05.185199+0000","last_undegraded":"2024-01-27T14:00:05.185199+0000","last_fullsized":"2024-01-27T14:00:05.185199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.997850+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T14:00:04.997850+0000","last_peered":"2024-01-27T14:00:04.997850+0000","last_clean":"2024-01-27T14:00:04.997850+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T14:00:04.997850+0000","last_undegraded":"2024-01-27T14:00:04.997850+0000","last_fullsized":"2024-01-27T14:00:04.997850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083482+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T14:00:05.083482+0000","last_peered":"2024-01-27T14:00:05.083482+0000","last_clean":"2024-01-27T14:00:05.083482+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T14:00:05.083482+0000","last_undegraded":"2024-01-27T14:00:05.083482+0000","last_fullsized":"2024-01-27T14:00:05.083482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3814,"num_write_kb":297749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4253,"ondisk_log_size":4253,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2213,"ondisk_log_size":2213,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37841560,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":8392,"num_write_kb":41932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":75683120,"data_compressed":6983726,"data_compressed_allocated":10756096,"data_compressed_original":34791424,"omap_allocated":0,"internal_metadata":0},"log_size":7946,"ondisk_log_size":7946,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58756,"kb_used_data":9532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313084,"statfs":{"total":96636764160,"available":96576598016,"internally_reserved":0,"allocated":9760768,"data_stored":12897988,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.19600000000000001},"max":{"1min":0.439,"5min":0.48499999999999999,"15min":0.62},"last":0.251}]},{"osd":1,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.314},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56799999999999995,"15min":0.622},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.65300000000000002,"5min":0.82399999999999995,"15min":0.879},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":483328,"data_stored":314404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29799999999999999,"15min":0.30599999999999999},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.42799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.442,"5min":0.497,"15min":0.61699999999999999},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22500000000000001},"max":{"1min":0.45300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46899999999999997,"5min":0.60399999999999998,"15min":0.63},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.223,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.59699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.376,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.224},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.79500000000000004},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29699999999999999},"max":{"1min":0.57799999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.79100000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.874},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.83199999999999996,"15min":0.88100000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.373,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":0.84899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.52400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42148,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329692,"statfs":{"total":96636764160,"available":96593604608,"internally_reserved":0,"allocated":2715648,"data_stored":4203962,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.317,"15min":0.314},"min":{"1min":0.191,"5min":0.191,"15min":0.19},"max":{"1min":0.46500000000000002,"5min":0.47899999999999998,"15min":0.51400000000000001},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.42499999999999999,"5min":0.54400000000000004,"15min":0.63200000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.317,"15min":0.318},"min":{"1min":0.221,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.72899999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.41999999999999998,"5min":0.51700000000000002,"15min":0.622},"last":0.315}]},{"osd":3,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.63500000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":1.0149999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.86899999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34599999999999997},"max":{"1min":0.66300000000000003,"5min":0.84299999999999997,"15min":0.871},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":1,"15min":1},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57999999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542486,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78296,"kb_used_data":16592,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293544,"statfs":{"total":96636764160,"available":96556589056,"internally_reserved":0,"allocated":16990208,"data_stored":25766272,"data_compressed":2458257,"data_compressed_allocated":3723264,"data_compressed_original":12673024,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.69999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.309},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72999999999999998},"last":0.68500000000000005}]},{"osd":1,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.71599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.68500000000000005},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.70199999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.70499999999999996}]},{"osd":3,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71799999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.19900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81299999999999994},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.23300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.85099999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.26000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.82699999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.28799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73384,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94298456,"statfs":{"total":96636764160,"available":96561618944,"internally_reserved":0,"allocated":11960320,"data_stored":16894162,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.438,"15min":0.433},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.84099999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.873},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.68200000000000005},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":0.66900000000000004,"15min":0.80200000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.89300000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.59999999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.91400000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.83899999999999997},"last":0.40699999999999997}]},{"osd":5,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.61899999999999999,"5min":0.68700000000000006,"15min":0.83599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.93500000000000005},"last":0.35999999999999999}]},{"osd":7,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.25900000000000001},"max":{"1min":0.65200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.81899999999999995,"15min":0.89500000000000002},"last":0.53700000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542485,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46000000000000002,"15min":0.434},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.20100000000000001},"max":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67300000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23799999999999999},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":0.504}]},{"osd":1,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57499999999999996,"5min":0.66300000000000003,"15min":0.76300000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.44400000000000001},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":1.101,"15min":1.101},"last":0.439},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70799999999999996},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.70099999999999996,"15min":0.71599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.76300000000000001},"last":0.45100000000000001}]},{"osd":6,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68999999999999995,"5min":0.754,"15min":0.76300000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.79100000000000004},"last":0.46500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542486,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41272,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330568,"statfs":{"total":96636764160,"available":96594501632,"internally_reserved":0,"allocated":6078464,"data_stored":8505008,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.72099999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.20699999999999999},"max":{"1min":0.65200000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66700000000000004},"last":0.503},{"interface":"front","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32400000000000001,"15min":0.222},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.83599999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.46500000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":0.872},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.78900000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.80900000000000005},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.65600000000000003,"5min":0.748,"15min":0.748},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.374}]},{"osd":6,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.85599999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437}]},{"osd":7,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":0.754,"15min":0.877},"last":0.40600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":5688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":5824512,"data_stored":9095888,"data_compressed":837553,"data_compressed_allocated":1253376,"data_compressed_original":4706304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.188,"15min":0.17899999999999999},"max":{"1min":0.41299999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.252},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.308},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.437,"5min":0.52600000000000002,"15min":0.59799999999999998},"last":0.42199999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.27300000000000002,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":0.502,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.252,"5min":0.246,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.63600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.23200000000000001},"max":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.78600000000000003},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33600000000000002,"15min":0.27800000000000002},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.91600000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.377,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.76500000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79300000000000004},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71999999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":8389246,"data_compressed":804970,"data_compressed_allocated":1208320,"data_compressed_original":4132864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2433024,"data_stored":4087688,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":198130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9478144,"data_stored":12781714,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8388734,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11677696,"data_stored":16777888,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16642048,"data_stored":25059630,"data_compressed":2425674,"data_compressed_allocated":3678208,"data_compressed_original":12099584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:00:12.370 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-27T14:00:12.370 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:00:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.516+0000 7f851ca2b640 1 Processor -- start 2024-01-27T14:00:12.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.516+0000 7f851ca2b640 1 -- start start 2024-01-27T14:00:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.517+0000 7f851ca2b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8518153a70 0x7f85180c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.517+0000 7f851ca2b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851806c4f0 0x7f851806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.517+0000 7f851ca2b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f851815ce20 0x7f851815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.517+0000 7f851ca2b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180c3f90 con 0x7f851815ce20 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.517+0000 7f851ca2b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851806c060 con 0x7f8518153a70 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.517+0000 7f851ca2b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85180670d0 con 0x7f851806c4f0 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.518+0000 7f8516d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f851815ce20 0x7f851815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.518+0000 7f850ffff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851806c4f0 0x7f851806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.518+0000 7f851659c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8518153a70 0x7f85180c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.518+0000 7f8516d9d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f851815ce20 0x7f851815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37086/0 (socket says 172.21.15.46:37086) 2024-01-27T14:00:12.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.518+0000 7f8516d9d640 1 -- 172.21.15.46:0/2443599740 learned_addr learned my addr 172.21.15.46:0/2443599740 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.520+0000 7f8516d9d640 1 -- 172.21.15.46:0/2443599740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851806c4f0 msgr2=0x7f851806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.520+0000 7f8516d9d640 1 --2- 172.21.15.46:0/2443599740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851806c4f0 0x7f851806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.520+0000 7f8516d9d640 1 -- 172.21.15.46:0/2443599740 >> v2:172.21.15.78:3300/0 conn(0x7f8518153a70 msgr2=0x7f85180c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.520+0000 7f8516d9d640 1 --2- 172.21.15.46:0/2443599740 >> v2:172.21.15.78:3300/0 conn(0x7f8518153a70 0x7f85180c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.520+0000 7f8516d9d640 1 -- 172.21.15.46:0/2443599740 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180cac10 con 0x7f851815ce20 2024-01-27T14:00:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.522+0000 7f8516d9d640 1 --2- 172.21.15.46:0/2443599740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f851815ce20 0x7f851815d290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f851806d0f0 tx=0x7f851002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180e9f10efa0083e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.526+0000 7f8515d9b640 1 -- 172.21.15.46:0/2443599740 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851002c9e0 con 0x7f851815ce20 2024-01-27T14:00:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.526+0000 7f8515d9b640 1 -- 172.21.15.46:0/2443599740 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851002cb40 con 0x7f851815ce20 2024-01-27T14:00:12.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.526+0000 7f8515d9b640 1 -- 172.21.15.46:0/2443599740 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100343f0 con 0x7f851815ce20 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 -- 172.21.15.46:0/2443599740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f851815ce20 msgr2=0x7f851815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 --2- 172.21.15.46:0/2443599740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f851815ce20 0x7f851815d290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f851806d0f0 tx=0x7f851002be40 comp rx=0 tx=0).stop 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 -- 172.21.15.46:0/2443599740 shutdown_connections 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 --2- 172.21.15.46:0/2443599740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f851815ce20 0x7f851815d290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 --2- 172.21.15.46:0/2443599740 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851806c4f0 0x7f851806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 --2- 172.21.15.46:0/2443599740 >> v2:172.21.15.78:3300/0 conn(0x7f8518153a70 0x7f85180c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 -- 172.21.15.46:0/2443599740 >> 172.21.15.46:0/2443599740 conn(0x7f851808b600 msgr2=0x7f85180663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:12.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 -- 172.21.15.46:0/2443599740 shutdown_connections 2024-01-27T14:00:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.527+0000 7f851ca2b640 1 -- 172.21.15.46:0/2443599740 wait complete. 2024-01-27T14:00:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 Processor -- start 2024-01-27T14:00:12.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 -- start start 2024-01-27T14:00:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806c4f0 0x7f851814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 0x7f8518149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851815ce20 0x7f851815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851814fd90 con 0x7f8518153a70 2024-01-27T14:00:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851814ffb0 con 0x7f851806c4f0 2024-01-27T14:00:12.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.529+0000 7f851ca2b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85181f0220 con 0x7f851815ce20 2024-01-27T14:00:12.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.530+0000 7f850ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 0x7f8518149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.530+0000 7f8516d9d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851815ce20 0x7f851815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.530+0000 7f851659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806c4f0 0x7f851814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.530+0000 7f850ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 0x7f8518149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37090/0 (socket says 172.21.15.46:37090) 2024-01-27T14:00:12.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.530+0000 7f850ffff640 1 -- 172.21.15.46:0/1340655909 learned_addr learned my addr 172.21.15.46:0/1340655909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.534+0000 7f850ffff640 1 -- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851815ce20 msgr2=0x7f851815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.534+0000 7f850ffff640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851815ce20 0x7f851815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.534+0000 7f850ffff640 1 -- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806c4f0 msgr2=0x7f851814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.534+0000 7f850ffff640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806c4f0 0x7f851814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.534+0000 7f850ffff640 1 -- 172.21.15.46:0/1340655909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510009b30 con 0x7f8518153a70 2024-01-27T14:00:12.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.534+0000 7f8516d9d640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851815ce20 0x7f851815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:00:12.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.536+0000 7f850ffff640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 0x7f8518149d40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f850000e870 tx=0x7f850000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.538+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000ee60 con 0x7f8518153a70 2024-01-27T14:00:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.538+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85181ef610 con 0x7f8518153a70 2024-01-27T14:00:12.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.538+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85181efbd0 con 0x7f8518153a70 2024-01-27T14:00:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.539+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8518067330 con 0x7f8518153a70 2024-01-27T14:00:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.540+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8500005990 con 0x7f8518153a70 2024-01-27T14:00:12.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.540+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500005d00 con 0x7f8518153a70 2024-01-27T14:00:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.807+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f850000c8e0 con 0x7f8518153a70 2024-01-27T14:00:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.807+0000 7f850effd640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f84f806aed0 0x7f84f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.807+0000 7f851659c640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f84f806aed0 0x7f84f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.808+0000 7f851659c640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f84f806aed0 0x7f84f806d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8508009aa0 tx=0x7f8508009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:12.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.823+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f85000588e0 con 0x7f8518153a70 2024-01-27T14:00:12.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.823+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8500054c20 con 0x7f8518153a70 2024-01-27T14:00:12.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:12.999+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f851815a730 con 0x7f84f806aed0 2024-01-27T14:00:12.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.008+0000 7f850effd640 1 -- 172.21.15.46:0/1340655909 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371403 (secure 0 0 0) 0x7f8508011a00 con 0x7f84f806aed0 2024-01-27T14:00:12.998 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:13.000 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:00:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f84f806aed0 msgr2=0x7f84f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f84f806aed0 0x7f84f806d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8508009aa0 tx=0x7f8508009190 comp rx=0 tx=0).stop 2024-01-27T14:00:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 msgr2=0x7f8518149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 0x7f8518149d40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f850000e870 tx=0x7f850000ed30 comp rx=0 tx=0).stop 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 shutdown_connections 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f84f806aed0 0x7f84f806d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f851815ce20 0x7f851815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8518153a70 0x7f8518149d40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 --2- 172.21.15.46:0/1340655909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f851806c4f0 0x7f851814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 >> 172.21.15.46:0/1340655909 conn(0x7f851808b600 msgr2=0x7f85180b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 shutdown_connections 2024-01-27T14:00:13.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.011+0000 7f851ca2b640 1 -- 172.21.15.46:0/1340655909 wait complete. 2024-01-27T14:00:13.009 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":869,"stamp":"2024-01-27T14:00:11.948735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38431928,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1007,"num_read_kb":1043,"num_write":12365,"num_write_kb":342097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14529,"ondisk_log_size":14529,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397984,"kb_used_data":52832,"kb_used_omap":12,"kb_used_meta":345075,"kb_avail":754576736,"statfs":{"total":773094113280,"available":772686577664,"internally_reserved":0,"allocated":54099968,"data_stored":77794048,"data_compressed":7048892,"data_compressed_allocated":10846208,"data_compressed_original":35938304,"omap_allocated":12752,"internal_metadata":353357360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14522,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003084"},"pg_stats":[{"pgid":"2.1f","version":"27'623","reported_seq":662,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:17.541406+0000","last_change":"2024-01-27T13:32:12.373938+0000","last_active":"2024-01-27T13:59:17.541406+0000","last_peered":"2024-01-27T13:59:17.541406+0000","last_clean":"2024-01-27T13:59:17.541406+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T13:59:17.541406+0000","last_undegraded":"2024-01-27T13:59:17.541406+0000","last_fullsized":"2024-01-27T13:59:17.541406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:42:45.869600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'26","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010332+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T14:00:05.010332+0000","last_peered":"2024-01-27T14:00:05.010332+0000","last_clean":"2024-01-27T14:00:05.010332+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T14:00:05.010332+0000","last_undegraded":"2024-01-27T14:00:05.010332+0000","last_fullsized":"2024-01-27T14:00:05.010332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'150","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.965054+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:59:30.965054+0000","last_peered":"2024-01-27T13:59:30.965054+0000","last_clean":"2024-01-27T13:59:30.965054+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:59:30.965054+0000","last_undegraded":"2024-01-27T13:59:30.965054+0000","last_fullsized":"2024-01-27T13:59:30.965054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:11:01.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'716","reported_seq":755,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.518984+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T13:59:49.518984+0000","last_peered":"2024-01-27T13:59:49.518984+0000","last_clean":"2024-01-27T13:59:49.518984+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T13:59:49.518984+0000","last_undegraded":"2024-01-27T13:59:49.518984+0000","last_fullsized":"2024-01-27T13:59:49.518984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185102+0000","last_change":"2024-01-27T13:32:13.602079+0000","last_active":"2024-01-27T14:00:05.185102+0000","last_peered":"2024-01-27T14:00:05.185102+0000","last_clean":"2024-01-27T14:00:05.185102+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T14:00:05.185102+0000","last_undegraded":"2024-01-27T14:00:05.185102+0000","last_fullsized":"2024-01-27T14:00:05.185102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'132","reported_seq":161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787902+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:59:30.787902+0000","last_peered":"2024-01-27T13:59:30.787902+0000","last_clean":"2024-01-27T13:59:30.787902+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:59:30.787902+0000","last_undegraded":"2024-01-27T13:59:30.787902+0000","last_fullsized":"2024-01-27T13:59:30.787902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1388","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.618629+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:59:53.618629+0000","last_peered":"2024-01-27T13:59:53.618629+0000","last_clean":"2024-01-27T13:59:53.618629+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:59:53.618629+0000","last_undegraded":"2024-01-27T13:59:53.618629+0000","last_fullsized":"2024-01-27T13:59:53.618629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059839+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T14:00:05.059839+0000","last_peered":"2024-01-27T14:00:05.059839+0000","last_clean":"2024-01-27T14:00:05.059839+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T14:00:05.059839+0000","last_undegraded":"2024-01-27T14:00:05.059839+0000","last_fullsized":"2024-01-27T14:00:05.059839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'121","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.998050+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:59:33.998050+0000","last_peered":"2024-01-27T13:59:33.998050+0000","last_clean":"2024-01-27T13:59:33.998050+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:59:33.998050+0000","last_undegraded":"2024-01-27T13:59:33.998050+0000","last_fullsized":"2024-01-27T13:59:33.998050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:45.339471+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:59:45.339471+0000","last_peered":"2024-01-27T13:59:45.339471+0000","last_clean":"2024-01-27T13:59:45.339471+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:59:45.339471+0000","last_undegraded":"2024-01-27T13:59:45.339471+0000","last_fullsized":"2024-01-27T13:59:45.339471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.021532+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T14:00:05.021532+0000","last_peered":"2024-01-27T14:00:05.021532+0000","last_clean":"2024-01-27T14:00:05.021532+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T14:00:05.021532+0000","last_undegraded":"2024-01-27T14:00:05.021532+0000","last_fullsized":"2024-01-27T14:00:05.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'126","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.124660+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:59:32.124660+0000","last_peered":"2024-01-27T13:59:32.124660+0000","last_clean":"2024-01-27T13:59:32.124660+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:59:32.124660+0000","last_undegraded":"2024-01-27T13:59:32.124660+0000","last_fullsized":"2024-01-27T13:59:32.124660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085606+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T14:00:05.085606+0000","last_peered":"2024-01-27T14:00:05.085606+0000","last_clean":"2024-01-27T14:00:05.085606+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T14:00:05.085606+0000","last_undegraded":"2024-01-27T14:00:05.085606+0000","last_fullsized":"2024-01-27T14:00:05.085606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'617","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617302+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:59:53.617302+0000","last_peered":"2024-01-27T13:59:53.617302+0000","last_clean":"2024-01-27T13:59:53.617302+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:59:53.617302+0000","last_undegraded":"2024-01-27T13:59:53.617302+0000","last_fullsized":"2024-01-27T13:59:53.617302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'102","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:27.902717+0000","last_change":"2024-01-27T13:32:51.707357+0000","last_active":"2024-01-27T13:59:27.902717+0000","last_peered":"2024-01-27T13:59:27.902717+0000","last_clean":"2024-01-27T13:59:27.902717+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T13:59:27.902717+0000","last_undegraded":"2024-01-27T13:59:27.902717+0000","last_fullsized":"2024-01-27T13:59:27.902717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:36:27.470407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'35","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.007850+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T14:00:05.007850+0000","last_peered":"2024-01-27T14:00:05.007850+0000","last_clean":"2024-01-27T14:00:05.007850+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T14:00:05.007850+0000","last_undegraded":"2024-01-27T14:00:05.007850+0000","last_fullsized":"2024-01-27T14:00:05.007850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:24:28.336350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:19.587073+0000","last_change":"2024-01-27T13:32:12.378293+0000","last_active":"2024-01-27T13:58:19.587073+0000","last_peered":"2024-01-27T13:58:19.587073+0000","last_clean":"2024-01-27T13:58:19.587073+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T13:58:19.587073+0000","last_undegraded":"2024-01-27T13:58:19.587073+0000","last_fullsized":"2024-01-27T13:58:19.587073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'162","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787700+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:59:30.787700+0000","last_peered":"2024-01-27T13:59:30.787700+0000","last_clean":"2024-01-27T13:59:30.787700+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:59:30.787700+0000","last_undegraded":"2024-01-27T13:59:30.787700+0000","last_fullsized":"2024-01-27T13:59:30.787700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":10103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'33","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067491+0000","last_change":"2024-01-27T13:32:51.715993+0000","last_active":"2024-01-27T14:00:05.067491+0000","last_peered":"2024-01-27T14:00:05.067491+0000","last_clean":"2024-01-27T14:00:05.067491+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T14:00:05.067491+0000","last_undegraded":"2024-01-27T14:00:05.067491+0000","last_fullsized":"2024-01-27T14:00:05.067491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.481531+0000","last_change":"2024-01-27T13:32:12.376214+0000","last_active":"2024-01-27T13:59:47.481531+0000","last_peered":"2024-01-27T13:59:47.481531+0000","last_clean":"2024-01-27T13:59:47.481531+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T13:59:47.481531+0000","last_undegraded":"2024-01-27T13:59:47.481531+0000","last_fullsized":"2024-01-27T13:59:47.481531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'135","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.546165+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:59:32.546165+0000","last_peered":"2024-01-27T13:59:32.546165+0000","last_clean":"2024-01-27T13:59:32.546165+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:59:32.546165+0000","last_undegraded":"2024-01-27T13:59:32.546165+0000","last_fullsized":"2024-01-27T13:59:32.546165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:58.099911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.532444+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:59:32.532444+0000","last_peered":"2024-01-27T13:59:32.532444+0000","last_clean":"2024-01-27T13:59:32.532444+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:59:32.532444+0000","last_undegraded":"2024-01-27T13:59:32.532444+0000","last_fullsized":"2024-01-27T13:59:32.532444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617100+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:59:53.617100+0000","last_peered":"2024-01-27T13:59:53.617100+0000","last_clean":"2024-01-27T13:59:53.617100+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:59:53.617100+0000","last_undegraded":"2024-01-27T13:59:53.617100+0000","last_fullsized":"2024-01-27T13:59:53.617100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'105","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217803+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:59:33.217803+0000","last_peered":"2024-01-27T13:59:33.217803+0000","last_clean":"2024-01-27T13:59:33.217803+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:59:33.217803+0000","last_undegraded":"2024-01-27T13:59:33.217803+0000","last_fullsized":"2024-01-27T13:59:33.217803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":9310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183310+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T14:00:05.183310+0000","last_peered":"2024-01-27T14:00:05.183310+0000","last_clean":"2024-01-27T14:00:05.183310+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T14:00:05.183310+0000","last_undegraded":"2024-01-27T14:00:05.183310+0000","last_fullsized":"2024-01-27T14:00:05.183310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:08:39.793659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632858+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:59:55.632858+0000","last_peered":"2024-01-27T13:59:55.632858+0000","last_clean":"2024-01-27T13:59:55.632858+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:59:55.632858+0000","last_undegraded":"2024-01-27T13:59:55.632858+0000","last_fullsized":"2024-01-27T13:59:55.632858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'127","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.215260+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:59:33.215260+0000","last_peered":"2024-01-27T13:59:33.215260+0000","last_clean":"2024-01-27T13:59:33.215260+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:59:33.215260+0000","last_undegraded":"2024-01-27T13:59:33.215260+0000","last_fullsized":"2024-01-27T13:59:33.215260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":6403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015387+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T14:00:05.015387+0000","last_peered":"2024-01-27T14:00:05.015387+0000","last_clean":"2024-01-27T14:00:05.015387+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T14:00:05.015387+0000","last_undegraded":"2024-01-27T14:00:05.015387+0000","last_fullsized":"2024-01-27T14:00:05.015387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'309","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.629384+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T13:59:58.629384+0000","last_peered":"2024-01-27T13:59:58.629384+0000","last_clean":"2024-01-27T13:59:58.629384+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T13:59:58.629384+0000","last_undegraded":"2024-01-27T13:59:58.629384+0000","last_fullsized":"2024-01-27T13:59:58.629384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:35.400353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'143","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.047231+0000","last_change":"2024-01-27T13:32:51.674638+0000","last_active":"2024-01-27T13:59:35.047231+0000","last_peered":"2024-01-27T13:59:35.047231+0000","last_clean":"2024-01-27T13:59:35.047231+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T13:59:35.047231+0000","last_undegraded":"2024-01-27T13:59:35.047231+0000","last_fullsized":"2024-01-27T13:59:35.047231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:38.395479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'31","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999864+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T14:00:04.999864+0000","last_peered":"2024-01-27T14:00:04.999864+0000","last_clean":"2024-01-27T14:00:04.999864+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T14:00:04.999864+0000","last_undegraded":"2024-01-27T14:00:04.999864+0000","last_fullsized":"2024-01-27T14:00:04.999864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:43.240701+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:59:43.240701+0000","last_peered":"2024-01-27T13:59:43.240701+0000","last_clean":"2024-01-27T13:59:43.240701+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:59:43.240701+0000","last_undegraded":"2024-01-27T13:59:43.240701+0000","last_fullsized":"2024-01-27T13:59:43.240701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'116","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217955+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:59:33.217955+0000","last_peered":"2024-01-27T13:59:33.217955+0000","last_clean":"2024-01-27T13:59:33.217955+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:59:33.217955+0000","last_undegraded":"2024-01-27T13:59:33.217955+0000","last_fullsized":"2024-01-27T13:59:33.217955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:05.321933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017991+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T14:00:05.017991+0000","last_peered":"2024-01-27T14:00:05.017991+0000","last_clean":"2024-01-27T14:00:05.017991+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T14:00:05.017991+0000","last_undegraded":"2024-01-27T14:00:05.017991+0000","last_fullsized":"2024-01-27T14:00:05.017991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:50.528116+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:59:50.528116+0000","last_peered":"2024-01-27T13:59:50.528116+0000","last_clean":"2024-01-27T13:59:50.528116+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:59:50.528116+0000","last_undegraded":"2024-01-27T13:59:50.528116+0000","last_fullsized":"2024-01-27T13:59:50.528116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'170","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.545398+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:59:32.545398+0000","last_peered":"2024-01-27T13:59:32.545398+0000","last_clean":"2024-01-27T13:59:32.545398+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:59:32.545398+0000","last_undegraded":"2024-01-27T13:59:32.545398+0000","last_fullsized":"2024-01-27T13:59:32.545398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:17:10.788464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010376+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T14:00:05.010376+0000","last_peered":"2024-01-27T14:00:05.010376+0000","last_clean":"2024-01-27T14:00:05.010376+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T14:00:05.010376+0000","last_undegraded":"2024-01-27T14:00:05.010376+0000","last_fullsized":"2024-01-27T14:00:05.010376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.205445+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:59:42.205445+0000","last_peered":"2024-01-27T13:59:42.205445+0000","last_clean":"2024-01-27T13:59:42.205445+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:59:42.205445+0000","last_undegraded":"2024-01-27T13:59:42.205445+0000","last_fullsized":"2024-01-27T13:59:42.205445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'103","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.218046+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:59:33.218046+0000","last_peered":"2024-01-27T13:59:33.218046+0000","last_clean":"2024-01-27T13:59:33.218046+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:59:33.218046+0000","last_undegraded":"2024-01-27T13:59:33.218046+0000","last_fullsized":"2024-01-27T13:59:33.218046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:25.196252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999823+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T14:00:04.999823+0000","last_peered":"2024-01-27T14:00:04.999823+0000","last_clean":"2024-01-27T14:00:04.999823+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T14:00:04.999823+0000","last_undegraded":"2024-01-27T14:00:04.999823+0000","last_fullsized":"2024-01-27T14:00:04.999823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:28.474189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'896","reported_seq":1826,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:00.617248+0000","last_change":"2024-01-27T13:32:12.379085+0000","last_active":"2024-01-27T14:00:00.617248+0000","last_peered":"2024-01-27T14:00:00.617248+0000","last_clean":"2024-01-27T14:00:00.617248+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T14:00:00.617248+0000","last_undegraded":"2024-01-27T14:00:00.617248+0000","last_fullsized":"2024-01-27T14:00:00.617248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198130,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":891,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'141","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.444760+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:59:36.444760+0000","last_peered":"2024-01-27T13:59:36.444760+0000","last_clean":"2024-01-27T13:59:36.444760+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:59:36.444760+0000","last_undegraded":"2024-01-27T13:59:36.444760+0000","last_fullsized":"2024-01-27T13:59:36.444760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":10872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183662+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T14:00:05.183662+0000","last_peered":"2024-01-27T14:00:05.183662+0000","last_clean":"2024-01-27T14:00:05.183662+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T14:00:05.183662+0000","last_undegraded":"2024-01-27T14:00:05.183662+0000","last_fullsized":"2024-01-27T14:00:05.183662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:07:40.822258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'433","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.819081+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T14:00:04.819081+0000","last_peered":"2024-01-27T14:00:04.819081+0000","last_clean":"2024-01-27T14:00:04.819081+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T14:00:04.819081+0000","last_undegraded":"2024-01-27T14:00:04.819081+0000","last_fullsized":"2024-01-27T14:00:04.819081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087528,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'130","reported_seq":160,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.997593+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:59:33.997593+0000","last_peered":"2024-01-27T13:59:33.997593+0000","last_clean":"2024-01-27T13:59:33.997593+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:59:33.997593+0000","last_undegraded":"2024-01-27T13:59:33.997593+0000","last_fullsized":"2024-01-27T13:59:33.997593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:55.989279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":9704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013424+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T14:00:05.013424+0000","last_peered":"2024-01-27T14:00:05.013424+0000","last_clean":"2024-01-27T14:00:05.013424+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T14:00:05.013424+0000","last_undegraded":"2024-01-27T14:00:05.013424+0000","last_fullsized":"2024-01-27T14:00:05.013424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.520681+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:59:49.520681+0000","last_peered":"2024-01-27T13:59:49.520681+0000","last_clean":"2024-01-27T13:59:49.520681+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:59:49.520681+0000","last_undegraded":"2024-01-27T13:59:49.520681+0000","last_fullsized":"2024-01-27T13:59:49.520681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:08.571285+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:58:08.571285+0000","last_peered":"2024-01-27T13:58:08.571285+0000","last_clean":"2024-01-27T13:58:08.571285+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:58:08.571285+0000","last_undegraded":"2024-01-27T13:58:08.571285+0000","last_fullsized":"2024-01-27T13:58:08.571285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'154","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.219333+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:59:33.219333+0000","last_peered":"2024-01-27T13:59:33.219333+0000","last_clean":"2024-01-27T13:59:33.219333+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:59:33.219333+0000","last_undegraded":"2024-01-27T13:59:33.219333+0000","last_fullsized":"2024-01-27T13:59:33.219333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'32","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.098651+0000","last_change":"2024-01-27T13:32:51.718659+0000","last_active":"2024-01-27T14:00:05.098651+0000","last_peered":"2024-01-27T14:00:05.098651+0000","last_clean":"2024-01-27T14:00:05.098651+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T14:00:05.098651+0000","last_undegraded":"2024-01-27T14:00:05.098651+0000","last_fullsized":"2024-01-27T14:00:05.098651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:10:31.041312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:14.547664+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:59:14.547664+0000","last_peered":"2024-01-27T13:59:14.547664+0000","last_clean":"2024-01-27T13:59:14.547664+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:59:14.547664+0000","last_undegraded":"2024-01-27T13:59:14.547664+0000","last_fullsized":"2024-01-27T13:59:14.547664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'132","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:23.537428+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:59:23.537428+0000","last_peered":"2024-01-27T13:59:23.537428+0000","last_clean":"2024-01-27T13:59:23.537428+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:59:23.537428+0000","last_undegraded":"2024-01-27T13:59:23.537428+0000","last_fullsized":"2024-01-27T13:59:23.537428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":6638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'36","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067694+0000","last_change":"2024-01-27T13:32:51.673578+0000","last_active":"2024-01-27T14:00:05.067694+0000","last_peered":"2024-01-27T14:00:05.067694+0000","last_clean":"2024-01-27T14:00:05.067694+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T14:00:05.067694+0000","last_undegraded":"2024-01-27T14:00:05.067694+0000","last_fullsized":"2024-01-27T14:00:05.067694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:14.591258+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:59:14.591258+0000","last_peered":"2024-01-27T13:59:14.591258+0000","last_clean":"2024-01-27T13:59:14.591258+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:59:14.591258+0000","last_undegraded":"2024-01-27T13:59:14.591258+0000","last_fullsized":"2024-01-27T13:59:14.591258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:45:32.031270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'178","reported_seq":208,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100045+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:59:35.100045+0000","last_peered":"2024-01-27T13:59:35.100045+0000","last_clean":"2024-01-27T13:59:35.100045+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:59:35.100045+0000","last_undegraded":"2024-01-27T13:59:35.100045+0000","last_fullsized":"2024-01-27T13:59:35.100045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:15:27.634371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":15130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085883+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T14:00:05.085883+0000","last_peered":"2024-01-27T14:00:05.085883+0000","last_clean":"2024-01-27T14:00:05.085883+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T14:00:05.085883+0000","last_undegraded":"2024-01-27T14:00:05.085883+0000","last_fullsized":"2024-01-27T14:00:05.085883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.207807+0000","last_change":"2024-01-27T13:32:12.379113+0000","last_active":"2024-01-27T13:59:42.207807+0000","last_peered":"2024-01-27T13:59:42.207807+0000","last_clean":"2024-01-27T13:59:42.207807+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T13:59:42.207807+0000","last_undegraded":"2024-01-27T13:59:42.207807+0000","last_fullsized":"2024-01-27T13:59:42.207807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'133","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.996698+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:59:33.996698+0000","last_peered":"2024-01-27T13:59:33.996698+0000","last_clean":"2024-01-27T13:59:33.996698+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:59:33.996698+0000","last_undegraded":"2024-01-27T13:59:33.996698+0000","last_fullsized":"2024-01-27T13:59:33.996698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085515+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T14:00:05.085515+0000","last_peered":"2024-01-27T14:00:05.085515+0000","last_clean":"2024-01-27T14:00:05.085515+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T14:00:05.085515+0000","last_undegraded":"2024-01-27T14:00:05.085515+0000","last_fullsized":"2024-01-27T14:00:05.085515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:18.507104+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:59:18.507104+0000","last_peered":"2024-01-27T13:59:18.507104+0000","last_clean":"2024-01-27T13:59:18.507104+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:59:18.507104+0000","last_undegraded":"2024-01-27T13:59:18.507104+0000","last_fullsized":"2024-01-27T13:59:18.507104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'153","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.502177+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:59:32.502177+0000","last_peered":"2024-01-27T13:59:32.502177+0000","last_clean":"2024-01-27T13:59:32.502177+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:59:32.502177+0000","last_undegraded":"2024-01-27T13:59:32.502177+0000","last_fullsized":"2024-01-27T13:59:32.502177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":10566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083297+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T14:00:05.083297+0000","last_peered":"2024-01-27T14:00:05.083297+0000","last_clean":"2024-01-27T14:00:05.083297+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T14:00:05.083297+0000","last_undegraded":"2024-01-27T14:00:05.083297+0000","last_fullsized":"2024-01-27T14:00:05.083297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.746872+0000","last_change":"2024-01-27T13:32:12.381578+0000","last_active":"2024-01-27T13:59:58.746872+0000","last_peered":"2024-01-27T13:59:58.746872+0000","last_clean":"2024-01-27T13:59:58.746872+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T13:59:58.746872+0000","last_undegraded":"2024-01-27T13:59:58.746872+0000","last_fullsized":"2024-01-27T13:59:58.746872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'137","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.097101+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:59:35.097101+0000","last_peered":"2024-01-27T13:59:35.097101+0000","last_clean":"2024-01-27T13:59:35.097101+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:59:35.097101+0000","last_undegraded":"2024-01-27T13:59:35.097101+0000","last_fullsized":"2024-01-27T13:59:35.097101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":8266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.073366+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T14:00:05.073366+0000","last_peered":"2024-01-27T14:00:05.073366+0000","last_clean":"2024-01-27T14:00:05.073366+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T14:00:05.073366+0000","last_undegraded":"2024-01-27T14:00:05.073366+0000","last_fullsized":"2024-01-27T14:00:05.073366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:51.881725+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:59:51.881725+0000","last_peered":"2024-01-27T13:59:51.881725+0000","last_clean":"2024-01-27T13:59:51.881725+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:59:51.881725+0000","last_undegraded":"2024-01-27T13:59:51.881725+0000","last_fullsized":"2024-01-27T13:59:51.881725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":147,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107798+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:59:35.107798+0000","last_peered":"2024-01-27T13:59:35.107798+0000","last_clean":"2024-01-27T13:59:35.107798+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:59:35.107798+0000","last_undegraded":"2024-01-27T13:59:35.107798+0000","last_fullsized":"2024-01-27T13:59:35.107798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:27:22.236428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":8731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'42","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.126365+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T14:00:05.126365+0000","last_peered":"2024-01-27T14:00:05.126365+0000","last_clean":"2024-01-27T14:00:05.126365+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T14:00:05.126365+0000","last_undegraded":"2024-01-27T14:00:05.126365+0000","last_fullsized":"2024-01-27T14:00:05.126365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.630242+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:59:55.630242+0000","last_peered":"2024-01-27T13:59:55.630242+0000","last_clean":"2024-01-27T13:59:55.630242+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:59:55.630242+0000","last_undegraded":"2024-01-27T13:59:55.630242+0000","last_fullsized":"2024-01-27T13:59:55.630242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'100","reported_seq":129,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.778713+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:59:30.778713+0000","last_peered":"2024-01-27T13:59:30.778713+0000","last_clean":"2024-01-27T13:59:30.778713+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:59:30.778713+0000","last_undegraded":"2024-01-27T13:59:30.778713+0000","last_fullsized":"2024-01-27T13:59:30.778713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:25.403231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183338+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T14:00:05.183338+0000","last_peered":"2024-01-27T14:00:05.183338+0000","last_clean":"2024-01-27T14:00:05.183338+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T14:00:05.183338+0000","last_undegraded":"2024-01-27T14:00:05.183338+0000","last_fullsized":"2024-01-27T14:00:05.183338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:06:18.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.454697+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T13:59:47.454697+0000","last_peered":"2024-01-27T13:59:47.454697+0000","last_clean":"2024-01-27T13:59:47.454697+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T13:59:47.454697+0000","last_undegraded":"2024-01-27T13:59:47.454697+0000","last_fullsized":"2024-01-27T13:59:47.454697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:27:45.206994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'140","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.108071+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:59:35.108071+0000","last_peered":"2024-01-27T13:59:35.108071+0000","last_clean":"2024-01-27T13:59:35.108071+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:59:35.108071+0000","last_undegraded":"2024-01-27T13:59:35.108071+0000","last_fullsized":"2024-01-27T13:59:35.108071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":9178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083080+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T14:00:05.083080+0000","last_peered":"2024-01-27T14:00:05.083080+0000","last_clean":"2024-01-27T14:00:05.083080+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T14:00:05.083080+0000","last_undegraded":"2024-01-27T14:00:05.083080+0000","last_fullsized":"2024-01-27T14:00:05.083080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'861","reported_seq":898,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:47.482095+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:59:47.482095+0000","last_peered":"2024-01-27T13:59:47.482095+0000","last_clean":"2024-01-27T13:59:47.482095+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:59:47.482095+0000","last_undegraded":"2024-01-27T13:59:47.482095+0000","last_fullsized":"2024-01-27T13:59:47.482095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":4566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'134","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100208+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T13:59:35.100208+0000","last_peered":"2024-01-27T13:59:35.100208+0000","last_clean":"2024-01-27T13:59:35.100208+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T13:59:35.100208+0000","last_undegraded":"2024-01-27T13:59:35.100208+0000","last_fullsized":"2024-01-27T13:59:35.100208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:38.087007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'29","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018832+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T14:00:05.018832+0000","last_peered":"2024-01-27T14:00:05.018832+0000","last_clean":"2024-01-27T14:00:05.018832+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T14:00:05.018832+0000","last_undegraded":"2024-01-27T14:00:05.018832+0000","last_fullsized":"2024-01-27T14:00:05.018832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'604","reported_seq":641,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.760089+0000","last_change":"2024-01-27T13:32:12.377758+0000","last_active":"2024-01-27T13:59:58.760089+0000","last_peered":"2024-01-27T13:59:58.760089+0000","last_clean":"2024-01-27T13:59:58.760089+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T13:59:58.760089+0000","last_undegraded":"2024-01-27T13:59:58.760089+0000","last_fullsized":"2024-01-27T13:59:58.760089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:43.430890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'142","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.103737+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:59:35.103737+0000","last_peered":"2024-01-27T13:59:35.103737+0000","last_clean":"2024-01-27T13:59:35.103737+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:59:35.103737+0000","last_undegraded":"2024-01-27T13:59:35.103737+0000","last_fullsized":"2024-01-27T13:59:35.103737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":22998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185092+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T14:00:05.185092+0000","last_peered":"2024-01-27T14:00:05.185092+0000","last_clean":"2024-01-27T14:00:05.185092+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T14:00:05.185092+0000","last_undegraded":"2024-01-27T14:00:05.185092+0000","last_fullsized":"2024-01-27T14:00:05.185092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.195625+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:59:42.195625+0000","last_peered":"2024-01-27T13:59:42.195625+0000","last_clean":"2024-01-27T13:59:42.195625+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:59:42.195625+0000","last_undegraded":"2024-01-27T13:59:42.195625+0000","last_fullsized":"2024-01-27T13:59:42.195625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'115","reported_seq":144,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:25.616499+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T13:59:25.616499+0000","last_peered":"2024-01-27T13:59:25.616499+0000","last_clean":"2024-01-27T13:59:25.616499+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T13:59:25.616499+0000","last_undegraded":"2024-01-27T13:59:25.616499+0000","last_fullsized":"2024-01-27T13:59:25.616499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:22:58.834388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.056984+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T14:00:05.056984+0000","last_peered":"2024-01-27T14:00:05.056984+0000","last_clean":"2024-01-27T14:00:05.056984+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T14:00:05.056984+0000","last_undegraded":"2024-01-27T14:00:05.056984+0000","last_fullsized":"2024-01-27T14:00:05.056984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632091+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:59:55.632091+0000","last_peered":"2024-01-27T13:59:55.632091+0000","last_clean":"2024-01-27T13:59:55.632091+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:59:55.632091+0000","last_undegraded":"2024-01-27T13:59:55.632091+0000","last_fullsized":"2024-01-27T13:59:55.632091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'145","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107796+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T13:59:35.107796+0000","last_peered":"2024-01-27T13:59:35.107796+0000","last_clean":"2024-01-27T13:59:35.107796+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T13:59:35.107796+0000","last_undegraded":"2024-01-27T13:59:35.107796+0000","last_fullsized":"2024-01-27T13:59:35.107796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:23:49.943149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:25.616103+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T13:59:25.616103+0000","last_peered":"2024-01-27T13:59:25.616103+0000","last_clean":"2024-01-27T13:59:25.616103+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T13:59:25.616103+0000","last_undegraded":"2024-01-27T13:59:25.616103+0000","last_fullsized":"2024-01-27T13:59:25.616103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":11460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.003404+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T14:00:05.003404+0000","last_peered":"2024-01-27T14:00:05.003404+0000","last_clean":"2024-01-27T14:00:05.003404+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T14:00:05.003404+0000","last_undegraded":"2024-01-27T14:00:05.003404+0000","last_fullsized":"2024-01-27T14:00:05.003404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:48.616130+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:58:48.616130+0000","last_peered":"2024-01-27T13:58:48.616130+0000","last_clean":"2024-01-27T13:58:48.616130+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:58:48.616130+0000","last_undegraded":"2024-01-27T13:58:48.616130+0000","last_fullsized":"2024-01-27T13:58:48.616130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'150","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.795209+0000","last_change":"2024-01-27T13:32:51.707209+0000","last_active":"2024-01-27T13:59:30.795209+0000","last_peered":"2024-01-27T13:59:30.795209+0000","last_clean":"2024-01-27T13:59:30.795209+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T13:59:30.795209+0000","last_undegraded":"2024-01-27T13:59:30.795209+0000","last_fullsized":"2024-01-27T13:59:30.795209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:40.489268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":19231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.009681+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T14:00:05.009681+0000","last_peered":"2024-01-27T14:00:05.009681+0000","last_clean":"2024-01-27T14:00:05.009681+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T14:00:05.009681+0000","last_undegraded":"2024-01-27T14:00:05.009681+0000","last_fullsized":"2024-01-27T14:00:05.009681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:17:21.693309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.629429+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:59:55.629429+0000","last_peered":"2024-01-27T13:59:55.629429+0000","last_clean":"2024-01-27T13:59:55.629429+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:59:55.629429+0000","last_undegraded":"2024-01-27T13:59:55.629429+0000","last_fullsized":"2024-01-27T13:59:55.629429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:01.407909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'691","reported_seq":728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.515899+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:59:49.515899+0000","last_peered":"2024-01-27T13:59:49.515899+0000","last_clean":"2024-01-27T13:59:49.515899+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:59:49.515899+0000","last_undegraded":"2024-01-27T13:59:49.515899+0000","last_fullsized":"2024-01-27T13:59:49.515899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183916+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T14:00:05.183916+0000","last_peered":"2024-01-27T14:00:05.183916+0000","last_clean":"2024-01-27T14:00:05.183916+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T14:00:05.183916+0000","last_undegraded":"2024-01-27T14:00:05.183916+0000","last_fullsized":"2024-01-27T14:00:05.183916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'81","reported_seq":110,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.209016+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:59:33.209016+0000","last_peered":"2024-01-27T13:59:33.209016+0000","last_clean":"2024-01-27T13:59:33.209016+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:59:33.209016+0000","last_undegraded":"2024-01-27T13:59:33.209016+0000","last_fullsized":"2024-01-27T13:59:33.209016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:24:01.333837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'709","reported_seq":746,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:51.895033+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:59:51.895033+0000","last_peered":"2024-01-27T13:59:51.895033+0000","last_clean":"2024-01-27T13:59:51.895033+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:59:51.895033+0000","last_undegraded":"2024-01-27T13:59:51.895033+0000","last_fullsized":"2024-01-27T13:59:51.895033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018462+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T14:00:05.018462+0000","last_peered":"2024-01-27T14:00:05.018462+0000","last_clean":"2024-01-27T14:00:05.018462+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T14:00:05.018462+0000","last_undegraded":"2024-01-27T14:00:05.018462+0000","last_fullsized":"2024-01-27T14:00:05.018462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'143","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.451919+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:59:36.451919+0000","last_peered":"2024-01-27T13:59:36.451919+0000","last_clean":"2024-01-27T13:59:36.451919+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:59:36.451919+0000","last_undegraded":"2024-01-27T13:59:36.451919+0000","last_fullsized":"2024-01-27T13:59:36.451919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:47:55.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'46","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082677+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T14:00:05.082677+0000","last_peered":"2024-01-27T14:00:05.082677+0000","last_clean":"2024-01-27T14:00:05.082677+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T14:00:05.082677+0000","last_undegraded":"2024-01-27T14:00:05.082677+0000","last_fullsized":"2024-01-27T14:00:05.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.075513+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T14:00:05.075513+0000","last_peered":"2024-01-27T14:00:05.075513+0000","last_clean":"2024-01-27T14:00:05.075513+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T14:00:05.075513+0000","last_undegraded":"2024-01-27T14:00:05.075513+0000","last_fullsized":"2024-01-27T14:00:05.075513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:51:36.494902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.012785+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T14:00:05.012785+0000","last_peered":"2024-01-27T14:00:05.012785+0000","last_clean":"2024-01-27T14:00:05.012785+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T14:00:05.012785+0000","last_undegraded":"2024-01-27T14:00:05.012785+0000","last_fullsized":"2024-01-27T14:00:05.012785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183244+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T14:00:05.183244+0000","last_peered":"2024-01-27T14:00:05.183244+0000","last_clean":"2024-01-27T14:00:05.183244+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T14:00:05.183244+0000","last_undegraded":"2024-01-27T14:00:05.183244+0000","last_fullsized":"2024-01-27T14:00:05.183244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'24","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015849+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T14:00:05.015849+0000","last_peered":"2024-01-27T14:00:05.015849+0000","last_clean":"2024-01-27T14:00:05.015849+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T14:00:05.015849+0000","last_undegraded":"2024-01-27T14:00:05.015849+0000","last_fullsized":"2024-01-27T14:00:05.015849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'28","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.998880+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T14:00:04.998880+0000","last_peered":"2024-01-27T14:00:04.998880+0000","last_clean":"2024-01-27T14:00:04.998880+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T14:00:04.998880+0000","last_undegraded":"2024-01-27T14:00:04.998880+0000","last_fullsized":"2024-01-27T14:00:04.998880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083694+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T14:00:05.083694+0000","last_peered":"2024-01-27T14:00:05.083694+0000","last_clean":"2024-01-27T14:00:05.083694+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T14:00:05.083694+0000","last_undegraded":"2024-01-27T14:00:05.083694+0000","last_fullsized":"2024-01-27T14:00:05.083694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015521+0000","last_change":"2024-01-27T13:32:13.637862+0000","last_active":"2024-01-27T14:00:05.015521+0000","last_peered":"2024-01-27T14:00:05.015521+0000","last_clean":"2024-01-27T14:00:05.015521+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T14:00:05.015521+0000","last_undegraded":"2024-01-27T14:00:05.015521+0000","last_fullsized":"2024-01-27T14:00:05.015521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015254+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T14:00:05.015254+0000","last_peered":"2024-01-27T14:00:05.015254+0000","last_clean":"2024-01-27T14:00:05.015254+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T14:00:05.015254+0000","last_undegraded":"2024-01-27T14:00:05.015254+0000","last_fullsized":"2024-01-27T14:00:05.015254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.016145+0000","last_change":"2024-01-27T13:32:13.637961+0000","last_active":"2024-01-27T14:00:05.016145+0000","last_peered":"2024-01-27T14:00:05.016145+0000","last_clean":"2024-01-27T14:00:05.016145+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T14:00:05.016145+0000","last_undegraded":"2024-01-27T14:00:05.016145+0000","last_fullsized":"2024-01-27T14:00:05.016145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.051296+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T14:00:05.051296+0000","last_peered":"2024-01-27T14:00:05.051296+0000","last_clean":"2024-01-27T14:00:05.051296+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T14:00:05.051296+0000","last_undegraded":"2024-01-27T14:00:05.051296+0000","last_fullsized":"2024-01-27T14:00:05.051296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'45","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183325+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T14:00:05.183325+0000","last_peered":"2024-01-27T14:00:05.183325+0000","last_clean":"2024-01-27T14:00:05.183325+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T14:00:05.183325+0000","last_undegraded":"2024-01-27T14:00:05.183325+0000","last_fullsized":"2024-01-27T14:00:05.183325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082845+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T14:00:05.082845+0000","last_peered":"2024-01-27T14:00:05.082845+0000","last_clean":"2024-01-27T14:00:05.082845+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T14:00:05.082845+0000","last_undegraded":"2024-01-27T14:00:05.082845+0000","last_fullsized":"2024-01-27T14:00:05.082845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080535+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T14:00:05.080535+0000","last_peered":"2024-01-27T14:00:05.080535+0000","last_clean":"2024-01-27T14:00:05.080535+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T14:00:05.080535+0000","last_undegraded":"2024-01-27T14:00:05.080535+0000","last_fullsized":"2024-01-27T14:00:05.080535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.070906+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T14:00:05.070906+0000","last_peered":"2024-01-27T14:00:05.070906+0000","last_clean":"2024-01-27T14:00:05.070906+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T14:00:05.070906+0000","last_undegraded":"2024-01-27T14:00:05.070906+0000","last_fullsized":"2024-01-27T14:00:05.070906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:56:17.733092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'38","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015738+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T14:00:05.015738+0000","last_peered":"2024-01-27T14:00:05.015738+0000","last_clean":"2024-01-27T14:00:05.015738+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T14:00:05.015738+0000","last_undegraded":"2024-01-27T14:00:05.015738+0000","last_fullsized":"2024-01-27T14:00:05.015738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'36","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018782+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T14:00:05.018782+0000","last_peered":"2024-01-27T14:00:05.018782+0000","last_clean":"2024-01-27T14:00:05.018782+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T14:00:05.018782+0000","last_undegraded":"2024-01-27T14:00:05.018782+0000","last_fullsized":"2024-01-27T14:00:05.018782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.000016+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T14:00:05.000016+0000","last_peered":"2024-01-27T14:00:05.000016+0000","last_clean":"2024-01-27T14:00:05.000016+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T14:00:05.000016+0000","last_undegraded":"2024-01-27T14:00:05.000016+0000","last_fullsized":"2024-01-27T14:00:05.000016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183664+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T14:00:05.183664+0000","last_peered":"2024-01-27T14:00:05.183664+0000","last_clean":"2024-01-27T14:00:05.183664+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T14:00:05.183664+0000","last_undegraded":"2024-01-27T14:00:05.183664+0000","last_fullsized":"2024-01-27T14:00:05.183664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:19:02.720804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'37","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013192+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T14:00:05.013192+0000","last_peered":"2024-01-27T14:00:05.013192+0000","last_clean":"2024-01-27T14:00:05.013192+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T14:00:05.013192+0000","last_undegraded":"2024-01-27T14:00:05.013192+0000","last_fullsized":"2024-01-27T14:00:05.013192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015756+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T14:00:05.015756+0000","last_peered":"2024-01-27T14:00:05.015756+0000","last_clean":"2024-01-27T14:00:05.015756+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T14:00:05.015756+0000","last_undegraded":"2024-01-27T14:00:05.015756+0000","last_fullsized":"2024-01-27T14:00:05.015756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080044+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T14:00:05.080044+0000","last_peered":"2024-01-27T14:00:05.080044+0000","last_clean":"2024-01-27T14:00:05.080044+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T14:00:05.080044+0000","last_undegraded":"2024-01-27T14:00:05.080044+0000","last_fullsized":"2024-01-27T14:00:05.080044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'44","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085310+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T14:00:05.085310+0000","last_peered":"2024-01-27T14:00:05.085310+0000","last_clean":"2024-01-27T14:00:05.085310+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T14:00:05.085310+0000","last_undegraded":"2024-01-27T14:00:05.085310+0000","last_fullsized":"2024-01-27T14:00:05.085310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'40","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.072171+0000","last_change":"2024-01-27T13:32:51.706601+0000","last_active":"2024-01-27T14:00:05.072171+0000","last_peered":"2024-01-27T14:00:05.072171+0000","last_clean":"2024-01-27T14:00:05.072171+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T14:00:05.072171+0000","last_undegraded":"2024-01-27T14:00:05.072171+0000","last_fullsized":"2024-01-27T14:00:05.072171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'30","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015304+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T14:00:05.015304+0000","last_peered":"2024-01-27T14:00:05.015304+0000","last_clean":"2024-01-27T14:00:05.015304+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T14:00:05.015304+0000","last_undegraded":"2024-01-27T14:00:05.015304+0000","last_fullsized":"2024-01-27T14:00:05.015304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:08:47.873530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.076729+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T14:00:05.076729+0000","last_peered":"2024-01-27T14:00:05.076729+0000","last_clean":"2024-01-27T14:00:05.076729+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T14:00:05.076729+0000","last_undegraded":"2024-01-27T14:00:05.076729+0000","last_fullsized":"2024-01-27T14:00:05.076729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017942+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T14:00:05.017942+0000","last_peered":"2024-01-27T14:00:05.017942+0000","last_clean":"2024-01-27T14:00:05.017942+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T14:00:05.017942+0000","last_undegraded":"2024-01-27T14:00:05.017942+0000","last_fullsized":"2024-01-27T14:00:05.017942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082979+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T14:00:05.082979+0000","last_peered":"2024-01-27T14:00:05.082979+0000","last_clean":"2024-01-27T14:00:05.082979+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T14:00:05.082979+0000","last_undegraded":"2024-01-27T14:00:05.082979+0000","last_fullsized":"2024-01-27T14:00:05.082979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'25","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059907+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T14:00:05.059907+0000","last_peered":"2024-01-27T14:00:05.059907+0000","last_clean":"2024-01-27T14:00:05.059907+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T14:00:05.059907+0000","last_undegraded":"2024-01-27T14:00:05.059907+0000","last_fullsized":"2024-01-27T14:00:05.059907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'39","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185199+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T14:00:05.185199+0000","last_peered":"2024-01-27T14:00:05.185199+0000","last_clean":"2024-01-27T14:00:05.185199+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T14:00:05.185199+0000","last_undegraded":"2024-01-27T14:00:05.185199+0000","last_fullsized":"2024-01-27T14:00:05.185199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'32","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.997850+0000","last_change":"2024-01-27T13:32:13.532762+0000","last_active":"2024-01-27T14:00:04.997850+0000","last_peered":"2024-01-27T14:00:04.997850+0000","last_clean":"2024-01-27T14:00:04.997850+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T14:00:04.997850+0000","last_undegraded":"2024-01-27T14:00:04.997850+0000","last_fullsized":"2024-01-27T14:00:04.997850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083482+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T14:00:05.083482+0000","last_peered":"2024-01-27T14:00:05.083482+0000","last_clean":"2024-01-27T14:00:05.083482+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T14:00:05.083482+0000","last_undegraded":"2024-01-27T14:00:05.083482+0000","last_fullsized":"2024-01-27T14:00:05.083482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3814,"num_write_kb":297749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4253,"ondisk_log_size":4253,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2213,"ondisk_log_size":2213,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37841560,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":8392,"num_write_kb":41932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":75683120,"data_compressed":6983726,"data_compressed_allocated":10756096,"data_compressed_original":34791424,"omap_allocated":0,"internal_metadata":0},"log_size":7946,"ondisk_log_size":7946,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509782,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58756,"kb_used_data":9532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313084,"statfs":{"total":96636764160,"available":96576598016,"internally_reserved":0,"allocated":9760768,"data_stored":12897988,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.19600000000000001},"max":{"1min":0.439,"5min":0.48499999999999999,"15min":0.62},"last":0.251}]},{"osd":1,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.314},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56799999999999995,"15min":0.622},"last":0.35599999999999998}]},{"osd":4,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.436},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.65300000000000002,"5min":0.82399999999999995,"15min":0.879},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.51600000000000001}]},{"osd":7,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509782,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":483328,"data_stored":314404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29799999999999999,"15min":0.30599999999999999},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.42799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.442,"5min":0.497,"15min":0.61699999999999999},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22500000000000001},"max":{"1min":0.45300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46899999999999997,"5min":0.60399999999999998,"15min":0.63},"last":0.34300000000000003}]},{"osd":3,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.223,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.59699999999999998},"last":0.374},{"interface":"front","average":{"1min":0.376,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.224},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.79500000000000004},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29699999999999999},"max":{"1min":0.57799999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.45900000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.79100000000000004},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.874},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.83199999999999996,"15min":0.88100000000000001},"last":0.42599999999999999}]},{"osd":7,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.373,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":0.84899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.52400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509782,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42148,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329692,"statfs":{"total":96636764160,"available":96593604608,"internally_reserved":0,"allocated":2715648,"data_stored":4203962,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.317,"15min":0.314},"min":{"1min":0.191,"5min":0.191,"15min":0.19},"max":{"1min":0.46500000000000002,"5min":0.47899999999999998,"15min":0.51400000000000001},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.42499999999999999,"5min":0.54400000000000004,"15min":0.63200000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.317,"15min":0.318},"min":{"1min":0.221,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.72899999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.41999999999999998,"5min":0.51700000000000002,"15min":0.622},"last":0.315}]},{"osd":3,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.63500000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":1.0149999999999999},"last":0.38800000000000001}]},{"osd":4,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.86899999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34599999999999997},"max":{"1min":0.66300000000000003,"5min":0.84299999999999997,"15min":0.871},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":1,"15min":1},"last":0.69099999999999995}]},{"osd":7,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57999999999999996}]}]},{"osd":7,"up_from":14,"seq":60129542486,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78296,"kb_used_data":16592,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293544,"statfs":{"total":96636764160,"available":96556589056,"internally_reserved":0,"allocated":16990208,"data_stored":25766272,"data_compressed":2458257,"data_compressed_allocated":3723264,"data_compressed_original":12673024,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.69999999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.309},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72999999999999998},"last":0.68500000000000005}]},{"osd":1,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.71599999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.68500000000000005},"last":0.57799999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.70199999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.70499999999999996}]},{"osd":3,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71799999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.19900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81299999999999994},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.23300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.85099999999999998},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.26000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.82699999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.28799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542486,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73384,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94298456,"statfs":{"total":96636764160,"available":96561618944,"internally_reserved":0,"allocated":11960320,"data_stored":16894162,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.438,"15min":0.433},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.84099999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.67300000000000004}]},{"osd":1,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.873},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.68200000000000005},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":0.66900000000000004,"15min":0.80200000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.89300000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.59999999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.57199999999999995}]},{"osd":4,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.91400000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.83899999999999997},"last":0.40699999999999997}]},{"osd":5,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.61899999999999999,"5min":0.68700000000000006,"15min":0.83599999999999997},"last":0.377},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.93500000000000005},"last":0.35999999999999999}]},{"osd":7,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.25900000000000001},"max":{"1min":0.65200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.81899999999999995,"15min":0.89500000000000002},"last":0.53700000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542485,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46000000000000002,"15min":0.434},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.20100000000000001},"max":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67300000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23799999999999999},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":0.504}]},{"osd":1,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57499999999999996,"5min":0.66300000000000003,"15min":0.76300000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.44400000000000001},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":1.101,"15min":1.101},"last":0.439},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70799999999999996},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.70099999999999996,"15min":0.71599999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.76300000000000001},"last":0.45100000000000001}]},{"osd":6,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68999999999999995,"5min":0.754,"15min":0.76300000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.79100000000000004},"last":0.46500000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542486,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41272,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330568,"statfs":{"total":96636764160,"available":96594501632,"internally_reserved":0,"allocated":6078464,"data_stored":8505008,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.72099999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.20699999999999999},"max":{"1min":0.65200000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66700000000000004},"last":0.503},{"interface":"front","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32400000000000001,"15min":0.222},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.83599999999999997},"last":0.47399999999999998}]},{"osd":2,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.46500000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":0.872},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.78900000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.80900000000000005},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.65600000000000003,"5min":0.748,"15min":0.748},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.374}]},{"osd":6,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.85599999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437}]},{"osd":7,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":0.754,"15min":0.877},"last":0.40600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575190,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":5688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":5824512,"data_stored":9095888,"data_compressed":837553,"data_compressed_allocated":1253376,"data_compressed_original":4706304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.188,"15min":0.17899999999999999},"max":{"1min":0.41299999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.252},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.308},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.437,"5min":0.52600000000000002,"15min":0.59799999999999998},"last":0.42199999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.27300000000000002,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":0.502,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.38},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.252,"5min":0.246,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.63600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.23200000000000001},"max":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.78600000000000003},"last":0.33100000000000002}]},{"osd":4,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33600000000000002,"15min":0.27800000000000002},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.91600000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.377,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.76500000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79300000000000004},"last":0.501}]},{"osd":6,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71999999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.65900000000000003}]},{"osd":7,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":8389246,"data_compressed":804970,"data_compressed_allocated":1208320,"data_compressed_original":4132864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2433024,"data_stored":4087688,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":198130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9478144,"data_stored":12781714,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8388734,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11677696,"data_stored":16777888,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16642048,"data_stored":25059630,"data_compressed":2425674,"data_compressed_allocated":3678208,"data_compressed_original":12099584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:00:13.015 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:00:13.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.165+0000 7f16759de640 1 Processor -- start 2024-01-27T14:00:13.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.166+0000 7f16759de640 1 -- start start 2024-01-27T14:00:13.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.166+0000 7f16759de640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16700c8ba0 0x7f16701580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:13.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.166+0000 7f16759de640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f167015ac20 0x7f1670151510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:13.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.166+0000 7f16759de640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1670158630 con 0x7f16700c8f80 2024-01-27T14:00:13.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.166+0000 7f16759de640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167015b0f0 con 0x7f16700c8ba0 2024-01-27T14:00:13.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.166+0000 7f16759de640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16700c6ec0 con 0x7f167015ac20 2024-01-27T14:00:13.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.167+0000 7f166effd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f16700c8ba0 0x7f16701580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:13.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.167+0000 7f1667fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f167015ac20 0x7f1670151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:13.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.167+0000 7f166f7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f16700c8f80 0x7f16700c73c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:42870/0 (socket says 172.21.15.46:42870) 2024-01-27T14:00:13.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.167+0000 7f166f7fe640 1 -- 172.21.15.46:0/467380717 learned_addr learned my addr 172.21.15.46:0/467380717 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.170+0000 7f1667fff640 1 -- 172.21.15.46:0/467380717 >> v2:172.21.15.46:3300/0 conn(0x7f16700c8ba0 msgr2=0x7f16701580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.170+0000 7f1667fff640 1 --2- 172.21.15.46:0/467380717 >> v2:172.21.15.46:3300/0 conn(0x7f16700c8ba0 0x7f16701580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.170+0000 7f1667fff640 1 -- 172.21.15.46:0/467380717 >> v1:172.21.15.46:6789/0 conn(0x7f16700c8f80 legacy=0x7f16700c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.170+0000 7f1667fff640 1 -- 172.21.15.46:0/467380717 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167015b3b0 con 0x7f167015ac20 2024-01-27T14:00:13.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.172+0000 7f1667fff640 1 --2- 172.21.15.46:0/467380717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f167015ac20 0x7f1670151510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16580097a0 tx=0x7f165802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba1a26222d15798f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.175+0000 7f166e7fc640 1 -- 172.21.15.46:0/467380717 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658031830 con 0x7f167015ac20 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f166e7fc640 1 -- 172.21.15.46:0/467380717 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1658031990 con 0x7f167015ac20 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f166e7fc640 1 -- 172.21.15.46:0/467380717 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658031d20 con 0x7f167015ac20 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 -- 172.21.15.46:0/467380717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f167015ac20 msgr2=0x7f1670151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 --2- 172.21.15.46:0/467380717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f167015ac20 0x7f1670151510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16580097a0 tx=0x7f165802b8d0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 -- 172.21.15.46:0/467380717 shutdown_connections 2024-01-27T14:00:13.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 --2- 172.21.15.46:0/467380717 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f167015ac20 0x7f1670151510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 --2- 172.21.15.46:0/467380717 >> v2:172.21.15.46:3300/0 conn(0x7f16700c8ba0 0x7f16701580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 -- 172.21.15.46:0/467380717 >> 172.21.15.46:0/467380717 conn(0x7f167006b820 msgr2=0x7f167006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:13.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 -- 172.21.15.46:0/467380717 shutdown_connections 2024-01-27T14:00:13.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.176+0000 7f16759de640 1 -- 172.21.15.46:0/467380717 wait complete. 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.177+0000 7f16759de640 1 Processor -- start 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 -- start start 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 0x7f167014a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16700c8f80 0x7f167014c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f167015ac20 0x7f16701595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16701ecff0 con 0x7f16700c8ba0 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16701ed850 con 0x7f167015ac20 2024-01-27T14:00:13.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.178+0000 7f16759de640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167014abb0 con 0x7f16700c8f80 2024-01-27T14:00:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.179+0000 7f166effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 0x7f167014a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.179+0000 7f166effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 0x7f167014a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37116/0 (socket says 172.21.15.46:37116) 2024-01-27T14:00:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.179+0000 7f166effd640 1 -- 172.21.15.46:0/1027579586 learned_addr learned my addr 172.21.15.46:0/1027579586 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.179+0000 7f1667fff640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16700c8f80 0x7f167014c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:13.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.179+0000 7f166f7fe640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f167015ac20 0x7f16701595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:13.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.182+0000 7f166effd640 1 -- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16700c8f80 msgr2=0x7f167014c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.182+0000 7f166effd640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16700c8f80 0x7f167014c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.182+0000 7f166effd640 1 -- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f167015ac20 msgr2=0x7f16701595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.182+0000 7f166effd640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f167015ac20 0x7f16701595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.182+0000 7f166effd640 1 -- 172.21.15.46:0/1027579586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658009400 con 0x7f16700c8ba0 2024-01-27T14:00:13.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.185+0000 7f166effd640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 0x7f167014a520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f166000d830 tx=0x7f166000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:13.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.189+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000b6c0 con 0x7f16700c8ba0 2024-01-27T14:00:13.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.189+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166000b820 con 0x7f16700c8ba0 2024-01-27T14:00:13.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.189+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166000bbb0 con 0x7f16700c8ba0 2024-01-27T14:00:13.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.189+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167014ae90 con 0x7f16700c8ba0 2024-01-27T14:00:13.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.189+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16701ed4e0 con 0x7f16700c8ba0 2024-01-27T14:00:13.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.190+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1670074410 con 0x7f16700c8ba0 2024-01-27T14:00:13.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.454+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f166001e460 con 0x7f16700c8ba0 2024-01-27T14:00:13.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.455+0000 7f166cff9640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f165006af50 0x7f165006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:13.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.455+0000 7f1667fff640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f165006af50 0x7f165006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:13.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.455+0000 7f1667fff640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f165006af50 0x7f165006d410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1658036000 tx=0x7f165803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:13.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.472+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f16600593b0 con 0x7f16700c8ba0 2024-01-27T14:00:13.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.472+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f16600556f0 con 0x7f16700c8ba0 2024-01-27T14:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.661+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f167014c910 con 0x7f16700c8ba0 2024-01-27T14:00:13.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.705+0000 7f166cff9640 1 -- 172.21.15.46:0/1027579586 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f1660058d10 con 0x7f16700c8ba0 2024-01-27T14:00:13.692 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:13.692 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:00:13.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f165006af50 msgr2=0x7f165006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f165006af50 0x7f165006d410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1658036000 tx=0x7f165803c040 comp rx=0 tx=0).stop 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 msgr2=0x7f167014a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 0x7f167014a520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f166000d830 tx=0x7f166000dcf0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 shutdown_connections 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f165006af50 0x7f165006d410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f167015ac20 0x7f16701595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f16700c8f80 0x7f167014c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 --2- 172.21.15.46:0/1027579586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16700c8ba0 0x7f167014a520 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 >> 172.21.15.46:0/1027579586 conn(0x7f167006b820 msgr2=0x7f167006ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 shutdown_connections 2024-01-27T14:00:13.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:13.707+0000 7f16759de640 1 -- 172.21.15.46:0/1027579586 wait complete. 2024-01-27T14:00:14.705 INFO:tasks.ceph:Scrubbing osd.0 2024-01-27T14:00:14.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.826+0000 7ff450205640 1 Processor -- start 2024-01-27T14:00:14.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.826+0000 7ff450205640 1 -- start start 2024-01-27T14:00:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.827+0000 7ff450205640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff448070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.827+0000 7ff450205640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7ff448072840 0x7ff4480c5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.827+0000 7ff450205640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff448071450 con 0x7ff44815a6c0 2024-01-27T14:00:14.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.827+0000 7ff450205640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480c1820 con 0x7ff448072840 2024-01-27T14:00:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.827+0000 7ff450205640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448157480 con 0x7ff448150830 2024-01-27T14:00:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.828+0000 7ff44dfa1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff448070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.828+0000 7ff44dfa1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff448070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:42388/0 (socket says 172.21.15.46:42388) 2024-01-27T14:00:14.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.828+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1267498722 learned_addr learned my addr 172.21.15.46:0/1267498722 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:14.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.830+0000 7ff44e7a2640 1 --2- 172.21.15.46:0/1267498722 >> v2:172.21.15.46:3300/0 conn(0x7ff448072840 0x7ff4480c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.831+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1267498722 >> v2:172.21.15.46:3300/0 conn(0x7ff448072840 msgr2=0x7ff4480c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.831+0000 7ff44dfa1640 1 --2- 172.21.15.46:0/1267498722 >> v2:172.21.15.46:3300/0 conn(0x7ff448072840 0x7ff4480c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.831+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1267498722 >> v1:172.21.15.78:6789/0 conn(0x7ff44815a6c0 legacy=0x7ff448156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.831+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1267498722 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448150c10 con 0x7ff448150830 2024-01-27T14:00:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.833+0000 7ff44dfa1640 1 --2- 172.21.15.46:0/1267498722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff448070f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff444009870 tx=0x7ff44402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dac6121f988b0e26 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff44cf9f640 1 -- 172.21.15.46:0/1267498722 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44402f840 con 0x7ff448150830 2024-01-27T14:00:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff44cf9f640 1 -- 172.21.15.46:0/1267498722 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44402f9a0 con 0x7ff448150830 2024-01-27T14:00:14.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff44cf9f640 1 -- 172.21.15.46:0/1267498722 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44402fd30 con 0x7ff448150830 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff450205640 1 -- 172.21.15.46:0/1267498722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 msgr2=0x7ff448070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff450205640 1 --2- 172.21.15.46:0/1267498722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff448070f10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff444009870 tx=0x7ff44402ba20 comp rx=0 tx=0).stop 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff450205640 1 -- 172.21.15.46:0/1267498722 shutdown_connections 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff450205640 1 --2- 172.21.15.46:0/1267498722 >> v2:172.21.15.46:3300/0 conn(0x7ff448072840 0x7ff4480c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff450205640 1 --2- 172.21.15.46:0/1267498722 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff448070f10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.837+0000 7ff450205640 1 -- 172.21.15.46:0/1267498722 >> 172.21.15.46:0/1267498722 conn(0x7ff44806eaa0 msgr2=0x7ff44806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.838+0000 7ff450205640 1 -- 172.21.15.46:0/1267498722 shutdown_connections 2024-01-27T14:00:14.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.838+0000 7ff450205640 1 -- 172.21.15.46:0/1267498722 wait complete. 2024-01-27T14:00:14.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 Processor -- start 2024-01-27T14:00:14.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 -- start start 2024-01-27T14:00:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff448072840 0x7ff4481f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff4480b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44815a6c0 0x7ff44814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448154c20 con 0x7ff448072840 2024-01-27T14:00:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448154480 con 0x7ff44815a6c0 2024-01-27T14:00:14.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.839+0000 7ff450205640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448155ec0 con 0x7ff448150830 2024-01-27T14:00:14.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.840+0000 7ff44dfa1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff448072840 0x7ff4481f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.840+0000 7ff44e7a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44815a6c0 0x7ff44814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.840+0000 7ff44d7a0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff4480b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.840+0000 7ff44dfa1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff448072840 0x7ff4481f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40776/0 (socket says 172.21.15.46:40776) 2024-01-27T14:00:14.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.840+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1026197837 learned_addr learned my addr 172.21.15.46:0/1026197837 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.844+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1026197837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 msgr2=0x7ff4480b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.844+0000 7ff44dfa1640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7ff448150830 0x7ff4480b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.844+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1026197837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44815a6c0 msgr2=0x7ff44814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.844+0000 7ff44dfa1640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff44815a6c0 0x7ff44814f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:14.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.844+0000 7ff44dfa1640 1 -- 172.21.15.46:0/1026197837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440094d0 con 0x7ff448072840 2024-01-27T14:00:14.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.846+0000 7ff44dfa1640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff448072840 0x7ff4481f2dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff444000c00 tx=0x7ff444004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.850+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44402f810 con 0x7ff448072840 2024-01-27T14:00:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.850+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444041400 con 0x7ff448072840 2024-01-27T14:00:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.850+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440417d0 con 0x7ff448072840 2024-01-27T14:00:14.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.850+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4481561a0 con 0x7ff448072840 2024-01-27T14:00:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.850+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480c8d20 con 0x7ff448072840 2024-01-27T14:00:14.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.851+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff448071e70 con 0x7ff448072840 2024-01-27T14:00:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.871+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff444041930 con 0x7ff448072840 2024-01-27T14:00:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.871+0000 7ff43e7fc640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42c06af50 0x7ff42c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.871+0000 7ff44d7a0640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42c06af50 0x7ff42c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.872+0000 7ff44d7a0640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42c06af50 0x7ff42c06d410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4480c9950 tx=0x7ff438009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.874+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff44403c070 con 0x7ff448072840 2024-01-27T14:00:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.874+0000 7ff43e7fc640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7ff42c0747b0 0x7ff42c076c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.874+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 --> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42c077320 con 0x7ff42c0747b0 2024-01-27T14:00:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.874+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff444077ef0 con 0x7ff448072840 2024-01-27T14:00:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.875+0000 7ff44e7a2640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7ff42c0747b0 0x7ff42c076c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.875+0000 7ff44e7a2640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7ff42c0747b0 0x7ff42c076c50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:14.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.875+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== osd.0 v2:172.21.15.46:6802/3092334120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff42c077320 con 0x7ff42c0747b0 2024-01-27T14:00:14.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 --> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4481571a0 con 0x7ff42c0747b0 2024-01-27T14:00:14.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff43e7fc640 1 -- 172.21.15.46:0/1026197837 <== osd.0 v2:172.21.15.46:6802/3092334120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff44000f560 con 0x7ff42c0747b0 2024-01-27T14:00:14.875 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:14.876 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:14.876 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7ff42c0747b0 msgr2=0x7ff42c076c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6802/3092334120,v1:172.21.15.46:6803/3092334120] conn(0x7ff42c0747b0 0x7ff42c076c50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42c06af50 msgr2=0x7ff42c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7ff42c06af50 0x7ff42c06d410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff4480c9950 tx=0x7ff438009040 comp rx=0 tx=0).stop 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff448072840 msgr2=0x7ff4481f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 --2- 172.21.15.46:0/1026197837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff448072840 0x7ff4481f2dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff444000c00 tx=0x7ff444004730 comp rx=0 tx=0).stop 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff44e7a2640 1 -- 172.21.15.46:0/1026197837 reap_dead start 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 shutdown_connections 2024-01-27T14:00:14.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 >> 172.21.15.46:0/1026197837 conn(0x7ff44806eaa0 msgr2=0x7ff44806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 shutdown_connections 2024-01-27T14:00:14.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:14.889+0000 7ff450205640 1 -- 172.21.15.46:0/1026197837 wait complete. 2024-01-27T14:00:14.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-27T14:00:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.002+0000 7fd88b25d640 1 Processor -- start 2024-01-27T14:00:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.002+0000 7fd88b25d640 1 -- start start 2024-01-27T14:00:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.003+0000 7fd88b25d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8840c4750 0x7fd8840c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.003+0000 7fd88b25d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88415a280 con 0x7fd884153ca0 2024-01-27T14:00:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.003+0000 7fd88b25d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88415a790 con 0x7fd8840c5b00 2024-01-27T14:00:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.003+0000 7fd88b25d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840c5f70 con 0x7fd8840c4750 2024-01-27T14:00:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.003+0000 7fd888ff9640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd884153ca0 0x7fd88406bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47416/0 (socket says 172.21.15.46:47416) 2024-01-27T14:00:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.003+0000 7fd888ff9640 1 -- 172.21.15.46:0/46658413 learned_addr learned my addr 172.21.15.46:0/46658413 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.004+0000 7fd883fff640 1 --2- 172.21.15.46:0/46658413 >> v2:172.21.15.78:3300/0 conn(0x7fd8840c4750 0x7fd8840c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.006+0000 7fd8837fe640 1 -- 172.21.15.46:0/46658413 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464993498 0 0) 0x7fd88415a280 con 0x7fd884153ca0 2024-01-27T14:00:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.006+0000 7fd8837fe640 1 -- 172.21.15.46:0/46658413 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd870003520 con 0x7fd884153ca0 2024-01-27T14:00:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.007+0000 7fd883fff640 1 -- 172.21.15.46:0/46658413 >> v1:172.21.15.78:6789/0 conn(0x7fd8840c5b00 legacy=0x7fd88406c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.007+0000 7fd883fff640 1 -- 172.21.15.46:0/46658413 >> v1:172.21.15.46:6789/0 conn(0x7fd884153ca0 legacy=0x7fd88406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.007+0000 7fd883fff640 1 -- 172.21.15.46:0/46658413 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88415a4b0 con 0x7fd8840c4750 2024-01-27T14:00:14.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.009+0000 7fd883fff640 1 --2- 172.21.15.46:0/46658413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8840c4750 0x7fd8840c41b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd8740097a0 tx=0x7fd87402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=add7aa8c9c9ff19f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.015+0000 7fd8837fe640 1 -- 172.21.15.46:0/46658413 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87402f810 con 0x7fd8840c4750 2024-01-27T14:00:15.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.015+0000 7fd8837fe640 1 -- 172.21.15.46:0/46658413 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87402f970 con 0x7fd8840c4750 2024-01-27T14:00:15.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.015+0000 7fd8837fe640 1 -- 172.21.15.46:0/46658413 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87402fd00 con 0x7fd8840c4750 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 -- 172.21.15.46:0/46658413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8840c4750 msgr2=0x7fd8840c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 --2- 172.21.15.46:0/46658413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8840c4750 0x7fd8840c41b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd8740097a0 tx=0x7fd87402b9f0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 -- 172.21.15.46:0/46658413 shutdown_connections 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 --2- 172.21.15.46:0/46658413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8840c4750 0x7fd8840c41b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 -- 172.21.15.46:0/46658413 >> 172.21.15.46:0/46658413 conn(0x7fd8840cf230 msgr2=0x7fd8840cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 -- 172.21.15.46:0/46658413 shutdown_connections 2024-01-27T14:00:15.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.016+0000 7fd88b25d640 1 -- 172.21.15.46:0/46658413 wait complete. 2024-01-27T14:00:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.017+0000 7fd88b25d640 1 Processor -- start 2024-01-27T14:00:15.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.017+0000 7fd88b25d640 1 -- start start 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.018+0000 7fd88b25d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8840c4750 0x7fd8840c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.018+0000 7fd88b25d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 0x7fd88415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.018+0000 7fd88b25d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd884153ca0 0x7fd88415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.018+0000 7fd88b25d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840cf870 con 0x7fd8840c5b00 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.018+0000 7fd88b25d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841ef960 con 0x7fd884153ca0 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.018+0000 7fd88b25d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841efc40 con 0x7fd8840c4750 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.019+0000 7fd883fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 0x7fd88415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.019+0000 7fd8897fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd884153ca0 0x7fd88415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.019+0000 7fd888ff9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8840c4750 0x7fd8840c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.019+0000 7fd883fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 0x7fd88415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40786/0 (socket says 172.21.15.46:40786) 2024-01-27T14:00:15.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.019+0000 7fd883fff640 1 -- 172.21.15.46:0/880355170 learned_addr learned my addr 172.21.15.46:0/880355170 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.022+0000 7fd8897fa640 1 -- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8840c4750 msgr2=0x7fd8840c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.022+0000 7fd8897fa640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8840c4750 0x7fd8840c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.022+0000 7fd8897fa640 1 -- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 msgr2=0x7fd88415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.022+0000 7fd8897fa640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 0x7fd88415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.022+0000 7fd8897fa640 1 -- 172.21.15.46:0/880355170 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874009400 con 0x7fd884153ca0 2024-01-27T14:00:15.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.022+0000 7fd883fff640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 0x7fd88415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:00:15.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.025+0000 7fd8897fa640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd884153ca0 0x7fd88415cb20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c390 tx=0x7fd86c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.029+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c0052d0 con 0x7fd884153ca0 2024-01-27T14:00:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.029+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c005430 con 0x7fd884153ca0 2024-01-27T14:00:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.029+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8841eff20 con 0x7fd884153ca0 2024-01-27T14:00:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.029+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c007260 con 0x7fd884153ca0 2024-01-27T14:00:15.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.029+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8841f04e0 con 0x7fd884153ca0 2024-01-27T14:00:15.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.030+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8840cfbc0 con 0x7fd884153ca0 2024-01-27T14:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.272+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd86c0073c0 con 0x7fd884153ca0 2024-01-27T14:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.272+0000 7fd8817fa640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd86406af20 0x7fd86406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.273+0000 7fd888ff9640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd86406af20 0x7fd86406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.273+0000 7fd888ff9640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd86406af20 0x7fd86406d3e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd87c005c00 tx=0x7fd87c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.275+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd86c007670 con 0x7fd884153ca0 2024-01-27T14:00:15.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.286+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd86c053c60 con 0x7fd884153ca0 2024-01-27T14:00:15.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.481+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8840c5300 con 0x7fd86406af20 2024-01-27T14:00:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.481+0000 7fd8817fa640 1 -- 172.21.15.46:0/880355170 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd87c001f60 con 0x7fd86406af20 2024-01-27T14:00:15.468 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 0 to deep-scrub 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd86406af20 msgr2=0x7fd86406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd86406af20 0x7fd86406d3e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd87c005c00 tx=0x7fd87c009040 comp rx=0 tx=0).stop 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd884153ca0 msgr2=0x7fd88415cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd884153ca0 0x7fd88415cb20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00c390 tx=0x7fd86c00c850 comp rx=0 tx=0).stop 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 shutdown_connections 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd86406af20 0x7fd86406d3e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd884153ca0 0x7fd88415cb20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8840c5b00 0x7fd88415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 --2- 172.21.15.46:0/880355170 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd8840c4750 0x7fd8840c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 >> 172.21.15.46:0/880355170 conn(0x7fd8840cf230 msgr2=0x7fd8840ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:15.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 shutdown_connections 2024-01-27T14:00:15.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.483+0000 7fd88b25d640 1 -- 172.21.15.46:0/880355170 wait complete. 2024-01-27T14:00:15.481 INFO:tasks.ceph:Scrubbing osd.1 2024-01-27T14:00:15.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.601+0000 7f279b477640 1 Processor -- start 2024-01-27T14:00:15.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.601+0000 7f279b477640 1 -- start start 2024-01-27T14:00:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.601+0000 7f279b477640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27941518d0 0x7f27940ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f279b477640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27940c7f90 0x7f27940c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f279b477640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27940c7bb0 con 0x7f279415aca0 2024-01-27T14:00:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f279b477640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2794158030 con 0x7f27940c7f90 2024-01-27T14:00:15.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f279b477640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27940c91e0 con 0x7f27941518d0 2024-01-27T14:00:15.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f2799a14640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27940c7f90 0x7f27940c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f2799a14640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f27940c7f90 0x7f27940c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40796/0 (socket says 172.21.15.46:40796) 2024-01-27T14:00:15.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f2799a14640 1 -- 172.21.15.46:0/471630263 learned_addr learned my addr 172.21.15.46:0/471630263 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:15.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.602+0000 7f2799213640 1 --2- 172.21.15.46:0/471630263 >> v2:172.21.15.78:3300/0 conn(0x7f27941518d0 0x7f27940ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.605+0000 7f2799a14640 1 -- 172.21.15.46:0/471630263 >> v2:172.21.15.78:3300/0 conn(0x7f27941518d0 msgr2=0x7f27940ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:15.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.605+0000 7f2799a14640 1 --2- 172.21.15.46:0/471630263 >> v2:172.21.15.78:3300/0 conn(0x7f27941518d0 0x7f27940ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.605+0000 7f2799a14640 1 -- 172.21.15.46:0/471630263 >> v1:172.21.15.78:6789/0 conn(0x7f279415aca0 legacy=0x7f27940c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.605+0000 7f2799a14640 1 -- 172.21.15.46:0/471630263 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27941576b0 con 0x7f27940c7f90 2024-01-27T14:00:15.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.607+0000 7f2799a14640 1 --2- 172.21.15.46:0/471630263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27940c7f90 0x7f27940c83c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f27940ca170 tx=0x7f278c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61508ed25a94797 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f278bfff640 1 -- 172.21.15.46:0/471630263 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c02ca80 con 0x7f27940c7f90 2024-01-27T14:00:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f278bfff640 1 -- 172.21.15.46:0/471630263 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c02cbe0 con 0x7f27940c7f90 2024-01-27T14:00:15.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f278bfff640 1 -- 172.21.15.46:0/471630263 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c0343f0 con 0x7f27940c7f90 2024-01-27T14:00:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 -- 172.21.15.46:0/471630263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27940c7f90 msgr2=0x7f27940c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 --2- 172.21.15.46:0/471630263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27940c7f90 0x7f27940c83c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f27940ca170 tx=0x7f278c02bee0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 -- 172.21.15.46:0/471630263 shutdown_connections 2024-01-27T14:00:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 --2- 172.21.15.46:0/471630263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f27940c7f90 0x7f27940c83c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 --2- 172.21.15.46:0/471630263 >> v2:172.21.15.78:3300/0 conn(0x7f27941518d0 0x7f27940ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 -- 172.21.15.46:0/471630263 >> 172.21.15.46:0/471630263 conn(0x7f279406f070 msgr2=0x7f279406f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 -- 172.21.15.46:0/471630263 shutdown_connections 2024-01-27T14:00:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.611+0000 7f279b477640 1 -- 172.21.15.46:0/471630263 wait complete. 2024-01-27T14:00:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 Processor -- start 2024-01-27T14:00:15.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 -- start start 2024-01-27T14:00:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27940c7f90 0x7f27941f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27941518d0 0x7f27941ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f279415aca0 0x7f2794156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27941589f0 con 0x7f279415aca0 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27941f07a0 con 0x7f27941518d0 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.613+0000 7f279b477640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27941ed210 con 0x7f27940c7f90 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.614+0000 7f2799a14640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f279415aca0 0x7f2794156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.614+0000 7f2799a14640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f279415aca0 0x7f2794156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40808/0 (socket says 172.21.15.46:40808) 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.614+0000 7f2799a14640 1 -- 172.21.15.46:0/2213186690 learned_addr learned my addr 172.21.15.46:0/2213186690 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.614+0000 7f2799213640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27940c7f90 0x7f27941f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.614+0000 7f2798a12640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27941518d0 0x7f27941ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.618+0000 7f2798a12640 1 -- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27940c7f90 msgr2=0x7f27941f1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.618+0000 7f2798a12640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f27940c7f90 0x7f27941f1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.618+0000 7f2798a12640 1 -- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f279415aca0 msgr2=0x7f2794156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.618+0000 7f2798a12640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f279415aca0 0x7f2794156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.618+0000 7f2798a12640 1 -- 172.21.15.46:0/2213186690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009b30 con 0x7f27941518d0 2024-01-27T14:00:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.620+0000 7f2798a12640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27941518d0 0x7f27941ed9f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f278400c3c0 tx=0x7f278400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.624+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840052d0 con 0x7f27941518d0 2024-01-27T14:00:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.624+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784005450 con 0x7f27941518d0 2024-01-27T14:00:15.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.624+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784007260 con 0x7f27941518d0 2024-01-27T14:00:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.624+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2794158c90 con 0x7f27941518d0 2024-01-27T14:00:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.624+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2794159250 con 0x7f27941518d0 2024-01-27T14:00:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.625+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2794150fd0 con 0x7f27941518d0 2024-01-27T14:00:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.643+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f27840073c0 con 0x7f27941518d0 2024-01-27T14:00:15.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.643+0000 7f2789ffb640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f277806af20 0x7f277806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.643+0000 7f2799213640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f277806af20 0x7f277806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.644+0000 7f2799213640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f277806af20 0x7f277806d3e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2790009aa0 tx=0x7f2790009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.647+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2784058000 con 0x7f27941518d0 2024-01-27T14:00:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.647+0000 7f2789ffb640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7f2778074770 0x7f2778076c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.647+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 --> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27780772e0 con 0x7f2778074770 2024-01-27T14:00:15.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.647+0000 7f2799a14640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7f2778074770 0x7f2778076c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.647+0000 7f2799a14640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7f2778074770 0x7f2778076c10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.648+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== osd.1 v2:172.21.15.46:6810/2794574538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f27780772e0 con 0x7f2778074770 2024-01-27T14:00:15.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.648+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2784001000 con 0x7f27941518d0 2024-01-27T14:00:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.661+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 --> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f27940c9fc0 con 0x7f2778074770 2024-01-27T14:00:15.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f2789ffb640 1 -- 172.21.15.46:0/2213186690 <== osd.1 v2:172.21.15.46:6810/2794574538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f27940c9fc0 con 0x7f2778074770 2024-01-27T14:00:15.648 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:15.649 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:15.649 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:15.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7f2778074770 msgr2=0x7f2778076c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6810/2794574538,v1:172.21.15.46:6811/2794574538] conn(0x7f2778074770 0x7f2778076c10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f277806af20 msgr2=0x7f277806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f277806af20 0x7f277806d3e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2790009aa0 tx=0x7f2790009190 comp rx=0 tx=0).stop 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27941518d0 msgr2=0x7f27941ed9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 --2- 172.21.15.46:0/2213186690 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27941518d0 0x7f27941ed9f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f278400c3c0 tx=0x7f278400c880 comp rx=0 tx=0).stop 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f2799a14640 1 -- 172.21.15.46:0/2213186690 reap_dead start 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 shutdown_connections 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 >> 172.21.15.46:0/2213186690 conn(0x7f279406f070 msgr2=0x7f279406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 shutdown_connections 2024-01-27T14:00:15.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.662+0000 7f279b477640 1 -- 172.21.15.46:0/2213186690 wait complete. 2024-01-27T14:00:15.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-27T14:00:15.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.775+0000 7f4f17f05640 1 Processor -- start 2024-01-27T14:00:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.775+0000 7f4f17f05640 1 -- start start 2024-01-27T14:00:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.776+0000 7f4f17f05640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4f10153db0 0x7f4f1015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.776+0000 7f4f17f05640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1015a8a0 con 0x7f4f100c7690 2024-01-27T14:00:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.776+0000 7f4f17f05640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f100c99d0 con 0x7f4f100cb1e0 2024-01-27T14:00:15.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.776+0000 7f4f17f05640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100cab10 con 0x7f4f10153db0 2024-01-27T14:00:15.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.776+0000 7f4f164a2640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f4f100c7690 0x7f4f10164180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47430/0 (socket says 172.21.15.46:47430) 2024-01-27T14:00:15.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.776+0000 7f4f164a2640 1 -- 172.21.15.46:0/3889924937 learned_addr learned my addr 172.21.15.46:0/3889924937 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:15.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.777+0000 7f4f15ca1640 1 --2- 172.21.15.46:0/3889924937 >> v2:172.21.15.78:3300/0 conn(0x7f4f10153db0 0x7f4f1015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.779+0000 7f4f14c9f640 1 -- 172.21.15.46:0/3889924937 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752908057 0 0) 0x7f4f0c001490 con 0x7f4f100c7690 2024-01-27T14:00:15.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.779+0000 7f4f14c9f640 1 -- 172.21.15.46:0/3889924937 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4efc003520 con 0x7f4f100c7690 2024-01-27T14:00:15.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.780+0000 7f4f15ca1640 1 -- 172.21.15.46:0/3889924937 >> v1:172.21.15.78:6789/0 conn(0x7f4f100cb1e0 legacy=0x7f4f1006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.780+0000 7f4f15ca1640 1 -- 172.21.15.46:0/3889924937 >> v1:172.21.15.46:6789/0 conn(0x7f4f100c7690 legacy=0x7f4f10164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.780+0000 7f4f15ca1640 1 -- 172.21.15.46:0/3889924937 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f100c9c20 con 0x7f4f10153db0 2024-01-27T14:00:15.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.783+0000 7f4f15ca1640 1 --2- 172.21.15.46:0/3889924937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f10153db0 0x7f4f1015a360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f080097a0 tx=0x7f4f0802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b845b7d2f51d5f server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f14c9f640 1 -- 172.21.15.46:0/3889924937 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08030610 con 0x7f4f10153db0 2024-01-27T14:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f14c9f640 1 -- 172.21.15.46:0/3889924937 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08030770 con 0x7f4f10153db0 2024-01-27T14:00:15.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f14c9f640 1 -- 172.21.15.46:0/3889924937 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08030b00 con 0x7f4f10153db0 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f17f05640 1 -- 172.21.15.46:0/3889924937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f10153db0 msgr2=0x7f4f1015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f17f05640 1 --2- 172.21.15.46:0/3889924937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f10153db0 0x7f4f1015a360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f080097a0 tx=0x7f4f0802b960 comp rx=0 tx=0).stop 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f17f05640 1 -- 172.21.15.46:0/3889924937 shutdown_connections 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f17f05640 1 --2- 172.21.15.46:0/3889924937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f10153db0 0x7f4f1015a360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.787+0000 7f4f17f05640 1 -- 172.21.15.46:0/3889924937 >> 172.21.15.46:0/3889924937 conn(0x7f4f100cf050 msgr2=0x7f4f100cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.788+0000 7f4f17f05640 1 -- 172.21.15.46:0/3889924937 shutdown_connections 2024-01-27T14:00:15.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.788+0000 7f4f17f05640 1 -- 172.21.15.46:0/3889924937 wait complete. 2024-01-27T14:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 Processor -- start 2024-01-27T14:00:15.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 -- start start 2024-01-27T14:00:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f100c7690 0x7f4f10154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f100cb1e0 0x7f4f10154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 0x7f4f101559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f101f0050 con 0x7f4f10153db0 2024-01-27T14:00:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1015d690 con 0x7f4f100c7690 2024-01-27T14:00:15.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.789+0000 7f4f17f05640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f101ef460 con 0x7f4f100cb1e0 2024-01-27T14:00:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.790+0000 7f4f164a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 0x7f4f101559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.790+0000 7f4f164a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 0x7f4f101559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40810/0 (socket says 172.21.15.46:40810) 2024-01-27T14:00:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.790+0000 7f4f164a2640 1 -- 172.21.15.46:0/933485024 learned_addr learned my addr 172.21.15.46:0/933485024 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.790+0000 7f4f15ca1640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f100c7690 0x7f4f10154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.790+0000 7f4f154a0640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f100cb1e0 0x7f4f10154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.794+0000 7f4f164a2640 1 -- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f100cb1e0 msgr2=0x7f4f10154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.794+0000 7f4f164a2640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f100cb1e0 0x7f4f10154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.794+0000 7f4f164a2640 1 -- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f100c7690 msgr2=0x7f4f10154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.794+0000 7f4f164a2640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f100c7690 0x7f4f10154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:15.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.794+0000 7f4f164a2640 1 -- 172.21.15.46:0/933485024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08009400 con 0x7f4f10153db0 2024-01-27T14:00:15.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.796+0000 7f4f164a2640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 0x7f4f101559d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00cb40 tx=0x7f4f0c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.799+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00aca0 con 0x7f4f10153db0 2024-01-27T14:00:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.800+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c00ae00 con 0x7f4f10153db0 2024-01-27T14:00:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.800+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1015d930 con 0x7f4f10153db0 2024-01-27T14:00:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.800+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c012620 con 0x7f4f10153db0 2024-01-27T14:00:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.800+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f101efa00 con 0x7f4f10153db0 2024-01-27T14:00:15.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:15.800+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f100c6f60 con 0x7f4f10153db0 2024-01-27T14:00:16.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.062+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4f0c007070 con 0x7f4f10153db0 2024-01-27T14:00:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.062+0000 7f4f067fc640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ef406af20 0x7f4ef406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.062+0000 7f4f15ca1640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ef406af20 0x7f4ef406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.063+0000 7f4f15ca1640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ef406af20 0x7f4ef406d3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4f08036000 tx=0x7f4f0803b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.078+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f0c0584e0 con 0x7f4f10153db0 2024-01-27T14:00:16.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.078+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4f0c054820 con 0x7f4f10153db0 2024-01-27T14:00:16.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.276+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f100ca1e0 con 0x7f4ef406af20 2024-01-27T14:00:16.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.276+0000 7f4f067fc640 1 -- 172.21.15.46:0/933485024 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f0803f040 con 0x7f4ef406af20 2024-01-27T14:00:16.263 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 1 to deep-scrub 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ef406af20 msgr2=0x7f4ef406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ef406af20 0x7f4ef406d3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4f08036000 tx=0x7f4f0803b040 comp rx=0 tx=0).stop 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 msgr2=0x7f4f101559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 0x7f4f101559d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00cb40 tx=0x7f4f0c00a060 comp rx=0 tx=0).stop 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 shutdown_connections 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4ef406af20 0x7f4ef406d3e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f10153db0 0x7f4f101559d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4f100cb1e0 0x7f4f10154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 --2- 172.21.15.46:0/933485024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4f100c7690 0x7f4f10154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 >> 172.21.15.46:0/933485024 conn(0x7f4f100cf050 msgr2=0x7f4f100c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:16.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 shutdown_connections 2024-01-27T14:00:16.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.279+0000 7f4f17f05640 1 -- 172.21.15.46:0/933485024 wait complete. 2024-01-27T14:00:16.277 INFO:tasks.ceph:Scrubbing osd.2 2024-01-27T14:00:16.277 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.398+0000 7fd54105d640 1 Processor -- start 2024-01-27T14:00:16.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.398+0000 7fd54105d640 1 -- start start 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.399+0000 7fd54105d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd53c1518d0 0x7fd53c0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.399+0000 7fd54105d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c15aca0 0x7fd53c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.399+0000 7fd54105d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd53c0c7f90 0x7fd53c0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.399+0000 7fd54105d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c158030 con 0x7fd53c0c7f90 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.399+0000 7fd54105d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0c7bb0 con 0x7fd53c1518d0 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.399+0000 7fd54105d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1576b0 con 0x7fd53c15aca0 2024-01-27T14:00:16.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.400+0000 7fd53b59e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd53c0c7f90 0x7fd53c0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.400+0000 7fd53a59c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c15aca0 0x7fd53c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.400+0000 7fd53ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd53c1518d0 0x7fd53c0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.400+0000 7fd53b59e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fd53c0c7f90 0x7fd53c0c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40822/0 (socket says 172.21.15.46:40822) 2024-01-27T14:00:16.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.400+0000 7fd53b59e640 1 -- 172.21.15.46:0/954315833 learned_addr learned my addr 172.21.15.46:0/954315833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:16.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.402+0000 7fd53b59e640 1 -- 172.21.15.46:0/954315833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c15aca0 msgr2=0x7fd53c0c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.402+0000 7fd53b59e640 1 --2- 172.21.15.46:0/954315833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c15aca0 0x7fd53c0c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.402+0000 7fd53b59e640 1 -- 172.21.15.46:0/954315833 >> v2:172.21.15.78:3300/0 conn(0x7fd53c1518d0 msgr2=0x7fd53c0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.402+0000 7fd53b59e640 1 --2- 172.21.15.46:0/954315833 >> v2:172.21.15.78:3300/0 conn(0x7fd53c1518d0 0x7fd53c0ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.402+0000 7fd53b59e640 1 -- 172.21.15.46:0/954315833 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0c93d0 con 0x7fd53c0c7f90 2024-01-27T14:00:16.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.404+0000 7fd53b59e640 1 --2- 172.21.15.46:0/954315833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c8420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0ca170 tx=0x7fd52c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d70cd443ba6c9bf server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.408+0000 7fd539d9b640 1 -- 172.21.15.46:0/954315833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c02c9e0 con 0x7fd53c0c7f90 2024-01-27T14:00:16.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.408+0000 7fd539d9b640 1 -- 172.21.15.46:0/954315833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c02cb40 con 0x7fd53c0c7f90 2024-01-27T14:00:16.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.408+0000 7fd539d9b640 1 -- 172.21.15.46:0/954315833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0343f0 con 0x7fd53c0c7f90 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 -- 172.21.15.46:0/954315833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 msgr2=0x7fd53c0c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 --2- 172.21.15.46:0/954315833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c8420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0ca170 tx=0x7fd52c02be40 comp rx=0 tx=0).stop 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 -- 172.21.15.46:0/954315833 shutdown_connections 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 --2- 172.21.15.46:0/954315833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c8420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 --2- 172.21.15.46:0/954315833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c15aca0 0x7fd53c0c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 --2- 172.21.15.46:0/954315833 >> v2:172.21.15.78:3300/0 conn(0x7fd53c1518d0 0x7fd53c0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 -- 172.21.15.46:0/954315833 >> 172.21.15.46:0/954315833 conn(0x7fd53c06f070 msgr2=0x7fd53c06f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 -- 172.21.15.46:0/954315833 shutdown_connections 2024-01-27T14:00:16.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.409+0000 7fd54105d640 1 -- 172.21.15.46:0/954315833 wait complete. 2024-01-27T14:00:16.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.410+0000 7fd54105d640 1 Processor -- start 2024-01-27T14:00:16.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 -- start start 2024-01-27T14:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c1518d0 0x7fd53c154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c15aca0 0x7fd53c0cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1ee2b0 con 0x7fd53c0c7f90 2024-01-27T14:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1ed400 con 0x7fd53c15aca0 2024-01-27T14:00:16.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.411+0000 7fd54105d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c1ed6a0 con 0x7fd53c1518d0 2024-01-27T14:00:16.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.412+0000 7fd53ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.412+0000 7fd53ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40828/0 (socket says 172.21.15.46:40828) 2024-01-27T14:00:16.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.412+0000 7fd53ad9d640 1 -- 172.21.15.46:0/1533692462 learned_addr learned my addr 172.21.15.46:0/1533692462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:16.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.412+0000 7fd53b59e640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c15aca0 0x7fd53c0cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.412+0000 7fd53a59c640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c1518d0 0x7fd53c154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.415+0000 7fd53ad9d640 1 -- 172.21.15.46:0/1533692462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c1518d0 msgr2=0x7fd53c154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.415+0000 7fd53ad9d640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd53c1518d0 0x7fd53c154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.415+0000 7fd53ad9d640 1 -- 172.21.15.46:0/1533692462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c15aca0 msgr2=0x7fd53c0cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.415+0000 7fd53ad9d640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd53c15aca0 0x7fd53c0cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.415+0000 7fd53ad9d640 1 -- 172.21.15.46:0/1533692462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009b30 con 0x7fd53c0c7f90 2024-01-27T14:00:16.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.418+0000 7fd53ad9d640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c5410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd53400e870 tx=0x7fd53400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.420+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400ee60 con 0x7fd53c0c7f90 2024-01-27T14:00:16.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.420+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c1ed980 con 0x7fd53c0c7f90 2024-01-27T14:00:16.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.420+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c1edf40 con 0x7fd53c0c7f90 2024-01-27T14:00:16.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.421+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd53c157c50 con 0x7fd53c0c7f90 2024-01-27T14:00:16.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.422+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534005990 con 0x7fd53c0c7f90 2024-01-27T14:00:16.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.422+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534005d00 con 0x7fd53c0c7f90 2024-01-27T14:00:16.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.443+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd53400c940 con 0x7fd53c0c7f90 2024-01-27T14:00:16.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.443+0000 7fd5337fe640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd51c06af00 0x7fd51c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.444+0000 7fd53a59c640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd51c06af00 0x7fd51c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.444+0000 7fd53a59c640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd51c06af00 0x7fd51c06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd53c1eaf20 tx=0x7fd524009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.447+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd534058940 con 0x7fd53c0c7f90 2024-01-27T14:00:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.448+0000 7fd5337fe640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7fd51c0746e0 0x7fd51c076b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.448+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 --> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd51c077250 con 0x7fd51c0746e0 2024-01-27T14:00:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.448+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd534054c80 con 0x7fd53c0c7f90 2024-01-27T14:00:16.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.448+0000 7fd53b59e640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7fd51c0746e0 0x7fd51c076b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.448+0000 7fd53b59e640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7fd51c0746e0 0x7fd51c076b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.449+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== osd.2 v2:172.21.15.46:6826/2828306015 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd51c077250 con 0x7fd51c0746e0 2024-01-27T14:00:16.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.462+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 --> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd53c157970 con 0x7fd51c0746e0 2024-01-27T14:00:16.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd5337fe640 1 -- 172.21.15.46:0/1533692462 <== osd.2 v2:172.21.15.46:6826/2828306015 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd52c02c940 con 0x7fd51c0746e0 2024-01-27T14:00:16.449 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:16.449 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:16.449 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7fd51c0746e0 msgr2=0x7fd51c076b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6826/2828306015,v1:172.21.15.46:6827/2828306015] conn(0x7fd51c0746e0 0x7fd51c076b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd51c06af00 msgr2=0x7fd51c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd51c06af00 0x7fd51c06d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd53c1eaf20 tx=0x7fd524009190 comp rx=0 tx=0).stop 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 msgr2=0x7fd53c0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 --2- 172.21.15.46:0/1533692462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd53c0c7f90 0x7fd53c0c5410 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd53400e870 tx=0x7fd53400ed30 comp rx=0 tx=0).stop 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd53b59e640 1 -- 172.21.15.46:0/1533692462 reap_dead start 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 shutdown_connections 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 >> 172.21.15.46:0/1533692462 conn(0x7fd53c06f070 msgr2=0x7fd53c14f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 shutdown_connections 2024-01-27T14:00:16.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.463+0000 7fd54105d640 1 -- 172.21.15.46:0/1533692462 wait complete. 2024-01-27T14:00:16.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-27T14:00:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.576+0000 7f809a247640 1 Processor -- start 2024-01-27T14:00:16.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.576+0000 7f809a247640 1 -- start start 2024-01-27T14:00:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.577+0000 7f809a247640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c28c0 0x7f80940c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.577+0000 7f809a247640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f80940c2ca0 0x7f80941514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.577+0000 7f809a247640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80940ccf60 con 0x7f80940c77d0 2024-01-27T14:00:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.577+0000 7f809a247640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80940ca800 con 0x7f80940c2ca0 2024-01-27T14:00:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.577+0000 7f809a247640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80941576d0 con 0x7f80940c28c0 2024-01-27T14:00:16.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.578+0000 7f80937fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c28c0 0x7f80940c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.578+0000 7f8093fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f80940c77d0 0x7f8094157bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47432/0 (socket says 172.21.15.46:47432) 2024-01-27T14:00:16.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.578+0000 7f8093fff640 1 -- 172.21.15.46:0/2756393806 learned_addr learned my addr 172.21.15.46:0/2756393806 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:16.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.578+0000 7f8092ffd640 1 --2- 172.21.15.46:0/2756393806 >> v2:172.21.15.46:3300/0 conn(0x7f80940c2ca0 0x7f80941514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.580+0000 7f80937fe640 1 -- 172.21.15.46:0/2756393806 >> v2:172.21.15.46:3300/0 conn(0x7f80940c2ca0 msgr2=0x7f80941514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:16.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.580+0000 7f80937fe640 1 --2- 172.21.15.46:0/2756393806 >> v2:172.21.15.46:3300/0 conn(0x7f80940c2ca0 0x7f80941514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.580+0000 7f80937fe640 1 -- 172.21.15.46:0/2756393806 >> v1:172.21.15.46:6789/0 conn(0x7f80940c77d0 legacy=0x7f8094157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.580+0000 7f80937fe640 1 -- 172.21.15.46:0/2756393806 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940cd200 con 0x7f80940c28c0 2024-01-27T14:00:16.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.582+0000 7f80937fe640 1 --2- 172.21.15.46:0/2756393806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c28c0 0x7f80940c1cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80840097a0 tx=0x7f808402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0111bd266322843 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.586+0000 7f80927fc640 1 -- 172.21.15.46:0/2756393806 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084031830 con 0x7f80940c28c0 2024-01-27T14:00:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.586+0000 7f80927fc640 1 -- 172.21.15.46:0/2756393806 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8084031990 con 0x7f80940c28c0 2024-01-27T14:00:16.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.586+0000 7f80927fc640 1 -- 172.21.15.46:0/2756393806 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084031d20 con 0x7f80940c28c0 2024-01-27T14:00:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.586+0000 7f809a247640 1 -- 172.21.15.46:0/2756393806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c28c0 msgr2=0x7f80940c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.586+0000 7f809a247640 1 --2- 172.21.15.46:0/2756393806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c28c0 0x7f80940c1cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f80840097a0 tx=0x7f808402b8d0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.586+0000 7f809a247640 1 -- 172.21.15.46:0/2756393806 shutdown_connections 2024-01-27T14:00:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.587+0000 7f809a247640 1 --2- 172.21.15.46:0/2756393806 >> v2:172.21.15.46:3300/0 conn(0x7f80940c2ca0 0x7f80941514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.587+0000 7f809a247640 1 --2- 172.21.15.46:0/2756393806 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c28c0 0x7f80940c1cd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.587+0000 7f809a247640 1 -- 172.21.15.46:0/2756393806 >> 172.21.15.46:0/2756393806 conn(0x7f809406efe0 msgr2=0x7f809406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.587+0000 7f809a247640 1 -- 172.21.15.46:0/2756393806 shutdown_connections 2024-01-27T14:00:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.587+0000 7f809a247640 1 -- 172.21.15.46:0/2756393806 wait complete. 2024-01-27T14:00:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.588+0000 7f809a247640 1 Processor -- start 2024-01-27T14:00:16.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.588+0000 7f809a247640 1 -- start start 2024-01-27T14:00:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f809a247640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80940c28c0 0x7f80940c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f809a247640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c2ca0 0x7f8094154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f809a247640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 0x7f809414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f809a247640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80941ef430 con 0x7f80940c77d0 2024-01-27T14:00:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f809a247640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809406c930 con 0x7f80940c28c0 2024-01-27T14:00:16.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f809a247640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809406d100 con 0x7f80940c2ca0 2024-01-27T14:00:16.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f8093fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 0x7f809414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f8092ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c2ca0 0x7f8094154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f8093fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 0x7f809414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40838/0 (socket says 172.21.15.46:40838) 2024-01-27T14:00:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f8093fff640 1 -- 172.21.15.46:0/741723635 learned_addr learned my addr 172.21.15.46:0/741723635 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:16.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.589+0000 7f80937fe640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80940c28c0 0x7f80940c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.593+0000 7f8093fff640 1 -- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c2ca0 msgr2=0x7f8094154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.593+0000 7f8093fff640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c2ca0 0x7f8094154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.593+0000 7f8093fff640 1 -- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80940c28c0 msgr2=0x7f80940c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.593+0000 7f8093fff640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80940c28c0 0x7f80940c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:16.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.593+0000 7f8093fff640 1 -- 172.21.15.46:0/741723635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8084009400 con 0x7f80940c77d0 2024-01-27T14:00:16.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.595+0000 7f8093fff640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 0x7f809414f660 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f808c00cbc0 tx=0x7f808c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.599+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c00ace0 con 0x7f80940c77d0 2024-01-27T14:00:16.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.599+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00ae40 con 0x7f80940c77d0 2024-01-27T14:00:16.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.599+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80941f3240 con 0x7f80940c77d0 2024-01-27T14:00:16.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.599+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c012600 con 0x7f80940c77d0 2024-01-27T14:00:16.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.599+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809406cb80 con 0x7f80940c77d0 2024-01-27T14:00:16.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.600+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80941ef570 con 0x7f80940c77d0 2024-01-27T14:00:16.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.618+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f808c007070 con 0x7f80940c77d0 2024-01-27T14:00:16.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.619+0000 7f807bfff640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f808006af20 0x7f808006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:16.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.619+0000 7f80937fe640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f808006af20 0x7f808006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:16.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.619+0000 7f80937fe640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f808006af20 0x7f808006d3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8084036000 tx=0x7f808403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.874+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f808c0583b0 con 0x7f80940c77d0 2024-01-27T14:00:16.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:16.875+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f808c0546f0 con 0x7f80940c77d0 2024-01-27T14:00:17.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.053+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f80940cdaa0 con 0x7f808006af20 2024-01-27T14:00:17.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.054+0000 7f807bfff640 1 -- 172.21.15.46:0/741723635 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8084031b00 con 0x7f808006af20 2024-01-27T14:00:17.040 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 2 to deep-scrub 2024-01-27T14:00:17.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f808006af20 msgr2=0x7f808006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f808006af20 0x7f808006d3e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8084036000 tx=0x7f808403c040 comp rx=0 tx=0).stop 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 msgr2=0x7f809414f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 0x7f809414f660 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f808c00cbc0 tx=0x7f808c00a430 comp rx=0 tx=0).stop 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 shutdown_connections 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f808006af20 0x7f808006d3e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80940c77d0 0x7f809414f660 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f80940c2ca0 0x7f8094154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 --2- 172.21.15.46:0/741723635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80940c28c0 0x7f80940c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 >> 172.21.15.46:0/741723635 conn(0x7f809406efe0 msgr2=0x7f8094156ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 shutdown_connections 2024-01-27T14:00:17.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.056+0000 7f809a247640 1 -- 172.21.15.46:0/741723635 wait complete. 2024-01-27T14:00:17.053 INFO:tasks.ceph:Scrubbing osd.3 2024-01-27T14:00:17.053 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 Processor -- start 2024-01-27T14:00:17.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 -- start start 2024-01-27T14:00:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1fb80cbbe0 0x7f1fb80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1fb8153c00 0x7f1fb80ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb80cac90 con 0x7f1fb80cbfc0 2024-01-27T14:00:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb80c9f40 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.173+0000 7f1fbd53b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb815cc90 con 0x7f1fb8153c00 2024-01-27T14:00:17.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.174+0000 7f1fb77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1fb8153c00 0x7f1fb80ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.174+0000 7f1fb6ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1fb80cbbe0 0x7f1fb80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.174+0000 7f1fb6ffd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f1fb80cbbe0 0x7f1fb80c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40840/0 (socket says 172.21.15.46:40840) 2024-01-27T14:00:17.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.174+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/672030286 learned_addr learned my addr 172.21.15.46:0/672030286 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:17.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.176+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/672030286 >> v2:172.21.15.78:3300/0 conn(0x7f1fb8153c00 msgr2=0x7f1fb80ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.176+0000 7f1fb6ffd640 1 --2- 172.21.15.46:0/672030286 >> v2:172.21.15.78:3300/0 conn(0x7f1fb8153c00 0x7f1fb80ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.176+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/672030286 >> v1:172.21.15.78:6789/0 conn(0x7f1fb80cbfc0 legacy=0x7f1fb81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.176+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/672030286 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb815daf0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.178+0000 7f1fb6ffd640 1 --2- 172.21.15.46:0/672030286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80c9a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fb815da60 tx=0x7f1fa802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d62eebfdedb4ea server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fb67fc640 1 -- 172.21.15.46:0/672030286 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8030860 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fb67fc640 1 -- 172.21.15.46:0/672030286 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa80309c0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fb67fc640 1 -- 172.21.15.46:0/672030286 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8030d50 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 -- 172.21.15.46:0/672030286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 msgr2=0x7f1fb80c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 --2- 172.21.15.46:0/672030286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80c9a00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1fb815da60 tx=0x7f1fa802b9a0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 -- 172.21.15.46:0/672030286 shutdown_connections 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 --2- 172.21.15.46:0/672030286 >> v2:172.21.15.78:3300/0 conn(0x7f1fb8153c00 0x7f1fb80ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 --2- 172.21.15.46:0/672030286 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80c9a00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 -- 172.21.15.46:0/672030286 >> 172.21.15.46:0/672030286 conn(0x7f1fb808b600 msgr2=0x7f1fb80663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:17.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.191+0000 7f1fbd53b640 1 -- 172.21.15.46:0/672030286 shutdown_connections 2024-01-27T14:00:17.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.192+0000 7f1fbd53b640 1 -- 172.21.15.46:0/672030286 wait complete. 2024-01-27T14:00:17.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 Processor -- start 2024-01-27T14:00:17.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 -- start start 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb80cbfc0 0x7f1fb814ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fb8153c00 0x7f1fb814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb814e5a0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb814e880 con 0x7f1fb80cbfc0 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.193+0000 7f1fbd53b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb81efca0 con 0x7f1fb8153c00 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.194+0000 7f1fb77fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fb8153c00 0x7f1fb814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.195+0000 7f1fb77fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fb8153c00 0x7f1fb814f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:42494/0 (socket says 172.21.15.46:42494) 2024-01-27T14:00:17.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.195+0000 7f1fb77fe640 1 -- 172.21.15.46:0/4198290033 learned_addr learned my addr 172.21.15.46:0/4198290033 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.196+0000 7f1fb6ffd640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.196+0000 7f1faffff640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb80cbfc0 0x7f1fb814ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.199+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/4198290033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fb8153c00 msgr2=0x7f1fb814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.199+0000 7f1fb6ffd640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1fb8153c00 0x7f1fb814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.199+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/4198290033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb80cbfc0 msgr2=0x7f1fb814ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.199+0000 7f1fb6ffd640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1fb80cbfc0 0x7f1fb814ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.199+0000 7f1fb6ffd640 1 -- 172.21.15.46:0/4198290033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80094d0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.201+0000 7f1fb6ffd640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80b38b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80cc9a0 tx=0x7f1fa8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.210+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8039a90 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.210+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8039c10 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.210+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8043410 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.211+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb814f790 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.211+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb81eff10 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.211+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fb815d1c0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.281+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1fa804c3b0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.281+0000 7f1faf7fe640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f9806af20 0x7f1f9806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.281+0000 7f1faffff640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f9806af20 0x7f1f9806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.282+0000 7f1faffff640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f9806af20 0x7f1f9806d3e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1fb814e2e0 tx=0x7f1fa0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.285+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1fa807aea0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.285+0000 7f1faf7fe640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7f1f98074800 0x7f1f98076ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.286+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 --> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f98077370 con 0x7f1f98074800 2024-01-27T14:00:17.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.286+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fa80771e0 con 0x7f1fb80cbbe0 2024-01-27T14:00:17.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.286+0000 7f1fb77fe640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7f1f98074800 0x7f1f98076ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.286+0000 7f1fb77fe640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7f1f98074800 0x7f1f98076ca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.287+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== osd.3 v2:172.21.15.46:6818/3527109404 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1f98077370 con 0x7f1f98074800 2024-01-27T14:00:17.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.301+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 --> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1fb815cee0 con 0x7f1f98074800 2024-01-27T14:00:17.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.301+0000 7f1faf7fe640 1 -- 172.21.15.46:0/4198290033 <== osd.3 v2:172.21.15.46:6818/3527109404 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1fb000f040 con 0x7f1f98074800 2024-01-27T14:00:17.288 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:17.288 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:17.288 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:17.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7f1f98074800 msgr2=0x7f1f98076ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6818/3527109404,v1:172.21.15.46:6819/3527109404] conn(0x7f1f98074800 0x7f1f98076ca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f9806af20 msgr2=0x7f1f9806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1f9806af20 0x7f1f9806d3e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1fb814e2e0 tx=0x7f1fa0009040 comp rx=0 tx=0).stop 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 msgr2=0x7f1fb80b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 --2- 172.21.15.46:0/4198290033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fb80cbbe0 0x7f1fb80b38b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80cc9a0 tx=0x7f1fa8004730 comp rx=0 tx=0).stop 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fb77fe640 1 -- 172.21.15.46:0/4198290033 reap_dead start 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 shutdown_connections 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 >> 172.21.15.46:0/4198290033 conn(0x7f1fb808b600 msgr2=0x7f1fb806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 shutdown_connections 2024-01-27T14:00:17.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.302+0000 7f1fbd53b640 1 -- 172.21.15.46:0/4198290033 wait complete. 2024-01-27T14:00:17.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-27T14:00:17.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.417+0000 7f6c09f9e640 1 Processor -- start 2024-01-27T14:00:17.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.417+0000 7f6c09f9e640 1 -- start start 2024-01-27T14:00:17.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.417+0000 7f6c09f9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6c04153a50 0x7f6c040c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.417+0000 7f6c09f9e640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040c9480 con 0x7f6c04159950 2024-01-27T14:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.418+0000 7f6c09f9e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0406bfb0 con 0x7f6c040c77d0 2024-01-27T14:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.418+0000 7f6c09f9e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040c9740 con 0x7f6c04153a50 2024-01-27T14:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.418+0000 7f6c03fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f6c04159950 0x7f6c04159d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47444/0 (socket says 172.21.15.46:47444) 2024-01-27T14:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.418+0000 7f6c03fff640 1 -- 172.21.15.46:0/1715579228 learned_addr learned my addr 172.21.15.46:0/1715579228 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:17.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.418+0000 7f6c037fe640 1 --2- 172.21.15.46:0/1715579228 >> v2:172.21.15.78:3300/0 conn(0x7f6c04153a50 0x7f6c040c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.420+0000 7f6c027fc640 1 -- 172.21.15.46:0/1715579228 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398598098 0 0) 0x7f6c040c9480 con 0x7f6c04159950 2024-01-27T14:00:17.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.420+0000 7f6c027fc640 1 -- 172.21.15.46:0/1715579228 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bec003520 con 0x7f6c04159950 2024-01-27T14:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.421+0000 7f6c037fe640 1 -- 172.21.15.46:0/1715579228 >> v1:172.21.15.78:6789/0 conn(0x7f6c040c77d0 legacy=0x7f6c040c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.421+0000 7f6c037fe640 1 -- 172.21.15.46:0/1715579228 >> v1:172.21.15.46:6789/0 conn(0x7f6c04159950 legacy=0x7f6c04159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.421+0000 7f6c037fe640 1 -- 172.21.15.46:0/1715579228 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0406c290 con 0x7f6c04153a50 2024-01-27T14:00:17.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.423+0000 7f6c037fe640 1 --2- 172.21.15.46:0/1715579228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c04153a50 0x7f6c040c8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40097a0 tx=0x7f6bf402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cefb621ef7e39ec3 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.426+0000 7f6c027fc640 1 -- 172.21.15.46:0/1715579228 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf402f810 con 0x7f6c04153a50 2024-01-27T14:00:17.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.428+0000 7f6c027fc640 1 -- 172.21.15.46:0/1715579228 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf402f970 con 0x7f6c04153a50 2024-01-27T14:00:17.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.428+0000 7f6c027fc640 1 -- 172.21.15.46:0/1715579228 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf402fce0 con 0x7f6c04153a50 2024-01-27T14:00:17.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 -- 172.21.15.46:0/1715579228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c04153a50 msgr2=0x7f6c040c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/1715579228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c04153a50 0x7f6c040c8b80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40097a0 tx=0x7f6bf402b9f0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 -- 172.21.15.46:0/1715579228 shutdown_connections 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/1715579228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c04153a50 0x7f6c040c8b80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 -- 172.21.15.46:0/1715579228 >> 172.21.15.46:0/1715579228 conn(0x7f6c0406efe0 msgr2=0x7f6c0406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 -- 172.21.15.46:0/1715579228 shutdown_connections 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.429+0000 7f6c09f9e640 1 -- 172.21.15.46:0/1715579228 wait complete. 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.430+0000 7f6c09f9e640 1 Processor -- start 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.430+0000 7f6c09f9e640 1 -- start start 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.431+0000 7f6c09f9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c040c77d0 0x7f6c0414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.431+0000 7f6c09f9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 0x7f6c041ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.431+0000 7f6c09f9e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c04159950 0x7f6c04146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.431+0000 7f6c09f9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04147cd0 con 0x7f6c04153a50 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.431+0000 7f6c09f9e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c041f2ef0 con 0x7f6c040c77d0 2024-01-27T14:00:17.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.431+0000 7f6c09f9e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0414c5b0 con 0x7f6c04159950 2024-01-27T14:00:17.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.432+0000 7f6c02ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 0x7f6c041ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.432+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c040c77d0 0x7f6c0414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.432+0000 7f6c02ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 0x7f6c041ef050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40860/0 (socket says 172.21.15.46:40860) 2024-01-27T14:00:17.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.432+0000 7f6c02ffd640 1 -- 172.21.15.46:0/868701515 learned_addr learned my addr 172.21.15.46:0/868701515 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.435+0000 7f6c02ffd640 1 -- 172.21.15.46:0/868701515 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c04159950 msgr2=0x7f6c04146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.435+0000 7f6c02ffd640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c04159950 0x7f6c04146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.435+0000 7f6c02ffd640 1 -- 172.21.15.46:0/868701515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c040c77d0 msgr2=0x7f6c0414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.435+0000 7f6c02ffd640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c040c77d0 0x7f6c0414f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.435+0000 7f6c02ffd640 1 -- 172.21.15.46:0/868701515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4009400 con 0x7f6c04153a50 2024-01-27T14:00:17.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.438+0000 7f6c02ffd640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 0x7f6c041ef050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c400 tx=0x7f6bf800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.442+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80052d0 con 0x7f6c04153a50 2024-01-27T14:00:17.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.442+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8005450 con 0x7f6c04153a50 2024-01-27T14:00:17.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.442+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0414c890 con 0x7f6c04153a50 2024-01-27T14:00:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.442+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8007260 con 0x7f6c04153a50 2024-01-27T14:00:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.442+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c041f28a0 con 0x7f6c04153a50 2024-01-27T14:00:17.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.443+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c041f30a0 con 0x7f6c04153a50 2024-01-27T14:00:17.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.707+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6bf80073c0 con 0x7f6c04153a50 2024-01-27T14:00:17.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.707+0000 7f6bebfff640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6bf006af20 0x7f6bf006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:17.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.707+0000 7f6c037fe640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6bf006af20 0x7f6bf006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:17.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.708+0000 7f6c037fe640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6bf006af20 0x7f6bf006d3e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4036000 tx=0x7f6bf4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:17.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.722+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6bf8007670 con 0x7f6c04153a50 2024-01-27T14:00:17.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.722+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6bf8054010 con 0x7f6c04153a50 2024-01-27T14:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.900+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c0406c850 con 0x7f6bf006af20 2024-01-27T14:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.901+0000 7f6bebfff640 1 -- 172.21.15.46:0/868701515 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6bf403e040 con 0x7f6bf006af20 2024-01-27T14:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 3 to deep-scrub 2024-01-27T14:00:17.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6bf006af20 msgr2=0x7f6bf006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6bf006af20 0x7f6bf006d3e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4036000 tx=0x7f6bf4008030 comp rx=0 tx=0).stop 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 msgr2=0x7f6c041ef050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 0x7f6c041ef050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800c400 tx=0x7f6bf800c8c0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 shutdown_connections 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f6bf006af20 0x7f6bf006d3e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f6c04159950 0x7f6c04146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04153a50 0x7f6c041ef050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 --2- 172.21.15.46:0/868701515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c040c77d0 0x7f6c0414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:17.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 >> 172.21.15.46:0/868701515 conn(0x7f6c0406efe0 msgr2=0x7f6c04070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:17.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 shutdown_connections 2024-01-27T14:00:17.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:17.903+0000 7f6c09f9e640 1 -- 172.21.15.46:0/868701515 wait complete. 2024-01-27T14:00:17.900 INFO:tasks.ceph:Scrubbing osd.4 2024-01-27T14:00:17.900 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:18.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.020+0000 7fe6ba578640 1 Processor -- start 2024-01-27T14:00:18.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.020+0000 7fe6ba578640 1 -- start start 2024-01-27T14:00:18.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6ba578640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b4153c00 0x7fe6b40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6ba578640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b415cc90 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6ba578640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b415daf0 con 0x7fe6b40cbbe0 2024-01-27T14:00:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6ba578640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b40c9f40 con 0x7fe6b4153c00 2024-01-27T14:00:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6b37fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe6b40cbfc0 0x7fe6b406bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47452/0 (socket says 172.21.15.46:47452) 2024-01-27T14:00:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6b37fe640 1 -- 172.21.15.46:0/768559225 learned_addr learned my addr 172.21.15.46:0/768559225 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:18.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.021+0000 7fe6b8b15640 1 --2- 172.21.15.46:0/768559225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b4153c00 0x7fe6b40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507518920 0 0) 0x7fe6b415cc90 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe69c003520 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291974629 0 0) 0x7fe6b415daf0 con 0x7fe6b40cbbe0 2024-01-27T14:00:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b415cc90 con 0x7fe6b40cbbe0 2024-01-27T14:00:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b8b15640 1 -- 172.21.15.46:0/768559225 >> v1:172.21.15.78:6789/0 conn(0x7fe6b40cbbe0 legacy=0x7fe6b41534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b8b15640 1 -- 172.21.15.46:0/768559225 >> v1:172.21.15.46:6789/0 conn(0x7fe6b40cbfc0 legacy=0x7fe6b406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.024+0000 7fe6b8b15640 1 -- 172.21.15.46:0/768559225 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40670e0 con 0x7fe6b4153c00 2024-01-27T14:00:18.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.026+0000 7fe6b8b15640 1 --2- 172.21.15.46:0/768559225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b4153c00 0x7fe6b40c9a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009dc0 tx=0x7fe6ac02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b0a4cacb64df19 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.028+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac02ccd0 con 0x7fe6b4153c00 2024-01-27T14:00:18.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.030+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac02ce30 con 0x7fe6b4153c00 2024-01-27T14:00:18.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.030+0000 7fe6b2ffd640 1 -- 172.21.15.46:0/768559225 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac034640 con 0x7fe6b4153c00 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 -- 172.21.15.46:0/768559225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b4153c00 msgr2=0x7fe6b40c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 --2- 172.21.15.46:0/768559225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b4153c00 0x7fe6b40c9a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac009dc0 tx=0x7fe6ac02bf20 comp rx=0 tx=0).stop 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 -- 172.21.15.46:0/768559225 shutdown_connections 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 --2- 172.21.15.46:0/768559225 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b4153c00 0x7fe6b40c9a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 -- 172.21.15.46:0/768559225 >> 172.21.15.46:0/768559225 conn(0x7fe6b408b600 msgr2=0x7fe6b40663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 -- 172.21.15.46:0/768559225 shutdown_connections 2024-01-27T14:00:18.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.031+0000 7fe6ba578640 1 -- 172.21.15.46:0/768559225 wait complete. 2024-01-27T14:00:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.032+0000 7fe6ba578640 1 Processor -- start 2024-01-27T14:00:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.032+0000 7fe6ba578640 1 -- start start 2024-01-27T14:00:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6ba578640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b40cbbe0 0x7fe6b414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6ba578640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6b40cbfc0 0x7fe6b414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6ba578640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b4153c00 0x7fe6b414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6ba578640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b414ab80 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6ba578640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b414f7d0 con 0x7fe6b4153c00 2024-01-27T14:00:18.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6ba578640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b414fa30 con 0x7fe6b40cbbe0 2024-01-27T14:00:18.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6b40cbfc0 0x7fe6b414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6b8b15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b4153c00 0x7fe6b414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.033+0000 7fe6b3fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b40cbbe0 0x7fe6b414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.034+0000 7fe6b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6b40cbfc0 0x7fe6b414c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40870/0 (socket says 172.21.15.46:40870) 2024-01-27T14:00:18.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.034+0000 7fe6b37fe640 1 -- 172.21.15.46:0/2215434624 learned_addr learned my addr 172.21.15.46:0/2215434624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:18.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.037+0000 7fe6b37fe640 1 -- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b40cbbe0 msgr2=0x7fe6b414dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.037+0000 7fe6b37fe640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe6b40cbbe0 0x7fe6b414dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.037+0000 7fe6b37fe640 1 -- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b4153c00 msgr2=0x7fe6b414b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.037+0000 7fe6b37fe640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b4153c00 0x7fe6b414b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.037+0000 7fe6b37fe640 1 -- 172.21.15.46:0/2215434624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac009a70 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.039+0000 7fe6b37fe640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6b40cbfc0 0x7fe6b414c440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400c450 tx=0x7fe6a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.045+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4005ce0 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.045+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a4005e40 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.045+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40072b0 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.045+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b414d170 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.045+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b414a810 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.046+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6b415d4a0 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.068+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe6a4007410 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.068+0000 7fe6b0ff9640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe6a006aed0 0x7fe6a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.068+0000 7fe6b3fff640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe6a006aed0 0x7fe6a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.069+0000 7fe6b3fff640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe6a006aed0 0x7fe6a006d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8007fd0 tx=0x7fe6a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.072+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe6a4057fb0 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.072+0000 7fe6b0ff9640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7fe6a0074730 0x7fe6a0076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.072+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 --> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6a00772a0 con 0x7fe6a0074730 2024-01-27T14:00:18.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.072+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6a4057d80 con 0x7fe6b40cbfc0 2024-01-27T14:00:18.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.072+0000 7fe6b8b15640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7fe6a0074730 0x7fe6a0076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.072+0000 7fe6b8b15640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7fe6a0074730 0x7fe6a0076bd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.073+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== osd.4 v2:172.21.15.78:6808/3834088265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe6a00772a0 con 0x7fe6a0074730 2024-01-27T14:00:18.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.086+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 --> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe6b415d1c0 con 0x7fe6a0074730 2024-01-27T14:00:18.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6b0ff9640 1 -- 172.21.15.46:0/2215434624 <== osd.4 v2:172.21.15.78:6808/3834088265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe6ac009450 con 0x7fe6a0074730 2024-01-27T14:00:18.074 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:18.074 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:18.074 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7fe6a0074730 msgr2=0x7fe6a0076bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.78:6808/3834088265,v1:172.21.15.78:6810/3834088265] conn(0x7fe6a0074730 0x7fe6a0076bd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe6a006aed0 msgr2=0x7fe6a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe6a006aed0 0x7fe6a006d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8007fd0 tx=0x7fe6a8009040 comp rx=0 tx=0).stop 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6b40cbfc0 msgr2=0x7fe6b414c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 --2- 172.21.15.46:0/2215434624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe6b40cbfc0 0x7fe6b414c440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400c450 tx=0x7fe6a400c910 comp rx=0 tx=0).stop 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6b8b15640 1 -- 172.21.15.46:0/2215434624 reap_dead start 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 shutdown_connections 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 >> 172.21.15.46:0/2215434624 conn(0x7fe6b408b600 msgr2=0x7fe6b41522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 shutdown_connections 2024-01-27T14:00:18.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.087+0000 7fe6ba578640 1 -- 172.21.15.46:0/2215434624 wait complete. 2024-01-27T14:00:18.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.201+0000 7f563c1d1640 1 Processor -- start 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.201+0000 7f563c1d1640 1 -- start start 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563c1d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56340c4750 0x7f56340c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563c1d1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56340c5b00 0x7f56340c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563c1d1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563415a280 con 0x7f5634153ca0 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563c1d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340c5f70 con 0x7f56340c4750 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563c1d1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56340c6750 con 0x7f56340c5b00 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563976c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56340c4750 0x7f56340c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.202+0000 7f563a76e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f56340c5b00 0x7f56340c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.203+0000 7f563976c640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f56340c4750 0x7f56340c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40872/0 (socket says 172.21.15.46:40872) 2024-01-27T14:00:18.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.203+0000 7f563976c640 1 -- 172.21.15.46:0/2073204484 learned_addr learned my addr 172.21.15.46:0/2073204484 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.205+0000 7f563976c640 1 -- 172.21.15.46:0/2073204484 >> v2:172.21.15.78:3300/0 conn(0x7f56340c5b00 msgr2=0x7f56340c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.205+0000 7f563976c640 1 --2- 172.21.15.46:0/2073204484 >> v2:172.21.15.78:3300/0 conn(0x7f56340c5b00 0x7f56340c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.205+0000 7f563976c640 1 -- 172.21.15.46:0/2073204484 >> v1:172.21.15.78:6789/0 conn(0x7f5634153ca0 legacy=0x7f563406bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.205+0000 7f563976c640 1 -- 172.21.15.46:0/2073204484 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563415a790 con 0x7f56340c4750 2024-01-27T14:00:18.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.207+0000 7f563976c640 1 --2- 172.21.15.46:0/2073204484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c4750 0x7f56340c41b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f563408b060 tx=0x7f562402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5017521415bf4e88 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f5638f6b640 1 -- 172.21.15.46:0/2073204484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562402f850 con 0x7f56340c4750 2024-01-27T14:00:18.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f5638f6b640 1 -- 172.21.15.46:0/2073204484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562402f9b0 con 0x7f56340c4750 2024-01-27T14:00:18.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f5638f6b640 1 -- 172.21.15.46:0/2073204484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562402fd40 con 0x7f56340c4750 2024-01-27T14:00:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f563c1d1640 1 -- 172.21.15.46:0/2073204484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c4750 msgr2=0x7f56340c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2073204484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c4750 0x7f56340c41b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f563408b060 tx=0x7f562402ba30 comp rx=0 tx=0).stop 2024-01-27T14:00:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f563c1d1640 1 -- 172.21.15.46:0/2073204484 shutdown_connections 2024-01-27T14:00:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2073204484 >> v2:172.21.15.78:3300/0 conn(0x7f56340c5b00 0x7f56340c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2073204484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c4750 0x7f56340c41b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.211+0000 7f563c1d1640 1 -- 172.21.15.46:0/2073204484 >> 172.21.15.46:0/2073204484 conn(0x7f56340cf230 msgr2=0x7f56340cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:18.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.212+0000 7f563c1d1640 1 -- 172.21.15.46:0/2073204484 shutdown_connections 2024-01-27T14:00:18.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.212+0000 7f563c1d1640 1 -- 172.21.15.46:0/2073204484 wait complete. 2024-01-27T14:00:18.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 Processor -- start 2024-01-27T14:00:18.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 -- start start 2024-01-27T14:00:18.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56340c4750 0x7f56341ef790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c5b00 0x7f563415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5634153ca0 0x7f56340c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5634155f60 con 0x7f56340c5b00 2024-01-27T14:00:18.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563415be80 con 0x7f56340c4750 2024-01-27T14:00:18.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.213+0000 7f563c1d1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56340cdc50 con 0x7f5634153ca0 2024-01-27T14:00:18.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.214+0000 7f5639f6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56340c4750 0x7f56341ef790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.214+0000 7f563a76e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5634153ca0 0x7f56340c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.214+0000 7f5639f6d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56340c4750 0x7f56341ef790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56864/0 (socket says 172.21.15.46:56864) 2024-01-27T14:00:18.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.214+0000 7f5639f6d640 1 -- 172.21.15.46:0/2866028156 learned_addr learned my addr 172.21.15.46:0/2866028156 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:18.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.215+0000 7f563976c640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c5b00 0x7f563415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.219+0000 7f563976c640 1 -- 172.21.15.46:0/2866028156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5634153ca0 msgr2=0x7f56340c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.219+0000 7f563976c640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5634153ca0 0x7f56340c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.219+0000 7f563976c640 1 -- 172.21.15.46:0/2866028156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56340c4750 msgr2=0x7f56341ef790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.219+0000 7f563976c640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56340c4750 0x7f56341ef790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.219+0000 7f563976c640 1 -- 172.21.15.46:0/2866028156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56240094d0 con 0x7f56340c5b00 2024-01-27T14:00:18.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.222+0000 7f563976c640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c5b00 0x7f563415b940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f563406d750 tx=0x7f5624004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.225+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624037c40 con 0x7f56340c5b00 2024-01-27T14:00:18.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.225+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624037dc0 con 0x7f56340c5b00 2024-01-27T14:00:18.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.225+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240426c0 con 0x7f56340c5b00 2024-01-27T14:00:18.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.225+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5634156150 con 0x7f56340c5b00 2024-01-27T14:00:18.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.225+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5634156710 con 0x7f56340c5b00 2024-01-27T14:00:18.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.226+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5634074410 con 0x7f56340c5b00 2024-01-27T14:00:18.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.486+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f562402d3e0 con 0x7f56340c5b00 2024-01-27T14:00:18.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.486+0000 7f562a7fc640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f561806af50 0x7f561806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.486+0000 7f5639f6d640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f561806af50 0x7f561806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.487+0000 7f5639f6d640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f561806af50 0x7f561806d410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5630001840 tx=0x7f5630009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.504+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f562403c070 con 0x7f56340c5b00 2024-01-27T14:00:18.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.504+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5624077460 con 0x7f56340c5b00 2024-01-27T14:00:18.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.709+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f56340c5020 con 0x7f561806af50 2024-01-27T14:00:18.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.709+0000 7f562a7fc640 1 -- 172.21.15.46:0/2866028156 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f56300014e0 con 0x7f561806af50 2024-01-27T14:00:18.696 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 4 to deep-scrub 2024-01-27T14:00:18.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f561806af50 msgr2=0x7f561806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f561806af50 0x7f561806d410 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5630001840 tx=0x7f5630009040 comp rx=0 tx=0).stop 2024-01-27T14:00:18.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c5b00 msgr2=0x7f563415b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c5b00 0x7f563415b940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f563406d750 tx=0x7f5624004730 comp rx=0 tx=0).stop 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 shutdown_connections 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f561806af50 0x7f561806d410 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5634153ca0 0x7f56340c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f56340c5b00 0x7f563415b940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 --2- 172.21.15.46:0/2866028156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56340c4750 0x7f56341ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 >> 172.21.15.46:0/2866028156 conn(0x7f56340cf230 msgr2=0x7f56340ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 shutdown_connections 2024-01-27T14:00:18.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.711+0000 7f563c1d1640 1 -- 172.21.15.46:0/2866028156 wait complete. 2024-01-27T14:00:18.708 INFO:tasks.ceph:Scrubbing osd.5 2024-01-27T14:00:18.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:18.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.827+0000 7f9dda4da640 1 Processor -- start 2024-01-27T14:00:18.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.827+0000 7f9dda4da640 1 -- start start 2024-01-27T14:00:18.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.828+0000 7f9dda4da640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9dd4159990 0x7f9dd40c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.828+0000 7f9dda4da640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd40c8120 0x7f9dd40c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.828+0000 7f9dda4da640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd415d8c0 con 0x7f9dd4153a90 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.828+0000 7f9dda4da640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd40ca1e0 con 0x7f9dd4159990 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.828+0000 7f9dda4da640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd415dd50 con 0x7f9dd40c8120 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.829+0000 7f9dd3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f9dd4153a90 0x7f9dd40c2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47456/0 (socket says 172.21.15.46:47456) 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.829+0000 7f9dd3fff640 1 -- 172.21.15.46:0/3992260320 learned_addr learned my addr 172.21.15.46:0/3992260320 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.829+0000 7f9dd37fe640 1 --2- 172.21.15.46:0/3992260320 >> v2:172.21.15.78:3300/0 conn(0x7f9dd4159990 0x7f9dd40c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.829+0000 7f9dd8a77640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd40c8120 0x7f9dd40c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.831+0000 7f9dd2ffd640 1 -- 172.21.15.46:0/3992260320 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075493332 0 0) 0x7f9dd415d8c0 con 0x7f9dd4153a90 2024-01-27T14:00:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.831+0000 7f9dd2ffd640 1 -- 172.21.15.46:0/3992260320 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc0003520 con 0x7f9dd4153a90 2024-01-27T14:00:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.832+0000 7f9dd37fe640 1 -- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd40c8120 msgr2=0x7f9dd40c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.832+0000 7f9dd37fe640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd40c8120 0x7f9dd40c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.832+0000 7f9dd37fe640 1 -- 172.21.15.46:0/3992260320 >> v1:172.21.15.46:6789/0 conn(0x7f9dd4153a90 legacy=0x7f9dd40c2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.832+0000 7f9dd37fe640 1 -- 172.21.15.46:0/3992260320 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd40c9f00 con 0x7f9dd4159990 2024-01-27T14:00:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.832+0000 7f9dd8a77640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd40c8120 0x7f9dd40c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:00:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.835+0000 7f9dd37fe640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd4159990 0x7f9dd40c7be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097a0 tx=0x7f9dbc02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe91dc623a1aedd server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dd2ffd640 1 -- 172.21.15.46:0/3992260320 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc030800 con 0x7f9dd4159990 2024-01-27T14:00:18.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dd2ffd640 1 -- 172.21.15.46:0/3992260320 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc030960 con 0x7f9dd4159990 2024-01-27T14:00:18.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dd2ffd640 1 -- 172.21.15.46:0/3992260320 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc030cf0 con 0x7f9dd4159990 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 -- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd4159990 msgr2=0x7f9dd40c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd4159990 0x7f9dd40c7be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097a0 tx=0x7f9dbc02b940 comp rx=0 tx=0).stop 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 -- 172.21.15.46:0/3992260320 shutdown_connections 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd40c8120 0x7f9dd40c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 --2- 172.21.15.46:0/3992260320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd4159990 0x7f9dd40c7be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 -- 172.21.15.46:0/3992260320 >> 172.21.15.46:0/3992260320 conn(0x7f9dd40663a0 msgr2=0x7f9dd4066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 -- 172.21.15.46:0/3992260320 shutdown_connections 2024-01-27T14:00:18.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.839+0000 7f9dda4da640 1 -- 172.21.15.46:0/3992260320 wait complete. 2024-01-27T14:00:18.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.840+0000 7f9dda4da640 1 Processor -- start 2024-01-27T14:00:18.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 -- start start 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd40c8120 0x7f9dd4148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd4153a90 0x7f9dd41efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd4159990 0x7f9dd40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd414a650 con 0x7f9dd4159990 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4149fe0 con 0x7f9dd40c8120 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.841+0000 7f9dda4da640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd41ef7b0 con 0x7f9dd4153a90 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.842+0000 7f9dd8a77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd4159990 0x7f9dd40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.842+0000 7f9dd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd40c8120 0x7f9dd4148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.842+0000 7f9dd37fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd4153a90 0x7f9dd41efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.842+0000 7f9dd8a77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd4159990 0x7f9dd40cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40892/0 (socket says 172.21.15.46:40892) 2024-01-27T14:00:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.842+0000 7f9dd8a77640 1 -- 172.21.15.46:0/195011278 learned_addr learned my addr 172.21.15.46:0/195011278 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:18.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.846+0000 7f9dd8a77640 1 -- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd4153a90 msgr2=0x7f9dd41efc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.846+0000 7f9dd8a77640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f9dd4153a90 0x7f9dd41efc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.846+0000 7f9dd8a77640 1 -- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd40c8120 msgr2=0x7f9dd4148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.846+0000 7f9dd8a77640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9dd40c8120 0x7f9dd4148d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.846+0000 7f9dd8a77640 1 -- 172.21.15.46:0/195011278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc009a70 con 0x7f9dd4159990 2024-01-27T14:00:18.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.848+0000 7f9dd8a77640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd4159990 0x7f9dd40cd310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009e60 tx=0x7f9dcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.852+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc009cd0 con 0x7f9dd4159990 2024-01-27T14:00:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.852+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00f040 con 0x7f9dd4159990 2024-01-27T14:00:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.852+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc003990 con 0x7f9dd4159990 2024-01-27T14:00:18.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.852+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dbc009400 con 0x7f9dd4159990 2024-01-27T14:00:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.852+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd41492b0 con 0x7f9dd4159990 2024-01-27T14:00:18.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.853+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9dd41585b0 con 0x7f9dd4159990 2024-01-27T14:00:18.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.872+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9dcc027480 con 0x7f9dd4159990 2024-01-27T14:00:18.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.873+0000 7f9dd0ff9640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9db406af50 0x7f9db406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.873+0000 7f9dd3fff640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9db406af50 0x7f9db406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.873+0000 7f9dd3fff640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9db406af50 0x7f9db406d410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005880 tx=0x7f9dc4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.876+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9dcc059740 con 0x7f9dd4159990 2024-01-27T14:00:18.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.876+0000 7f9dd0ff9640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7f9db40747a0 0x7f9db4076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.876+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 --> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9db4077310 con 0x7f9db40747a0 2024-01-27T14:00:18.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.876+0000 7f9dd37fe640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7f9db40747a0 0x7f9db4076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.876+0000 7f9dd37fe640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7f9db40747a0 0x7f9db4076c40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:18.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.877+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== osd.5 v2:172.21.15.78:6824/4205695749 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9db4077310 con 0x7f9db40747a0 2024-01-27T14:00:18.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.877+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dcc055a80 con 0x7f9dd4159990 2024-01-27T14:00:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.891+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 --> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9dd415d550 con 0x7f9db40747a0 2024-01-27T14:00:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.891+0000 7f9dd0ff9640 1 -- 172.21.15.46:0/195011278 <== osd.5 v2:172.21.15.78:6824/4205695749 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9dbc030ad0 con 0x7f9db40747a0 2024-01-27T14:00:18.878 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:18.878 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:18.878 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.891+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7f9db40747a0 msgr2=0x7f9db4076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.891+0000 7f9dda4da640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.78:6824/4205695749,v1:172.21.15.78:6825/4205695749] conn(0x7f9db40747a0 0x7f9db4076c40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9db406af50 msgr2=0x7f9db406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f9db406af50 0x7f9db406d410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4005880 tx=0x7f9dc4009040 comp rx=0 tx=0).stop 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd4159990 msgr2=0x7f9dd40cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 --2- 172.21.15.46:0/195011278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd4159990 0x7f9dd40cd310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc009e60 tx=0x7f9dcc00c490 comp rx=0 tx=0).stop 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dd8a77640 1 -- 172.21.15.46:0/195011278 reap_dead start 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 shutdown_connections 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 >> 172.21.15.46:0/195011278 conn(0x7f9dd40663a0 msgr2=0x7f9dd4158930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 shutdown_connections 2024-01-27T14:00:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:18.892+0000 7f9dda4da640 1 -- 172.21.15.46:0/195011278 wait complete. 2024-01-27T14:00:18.888 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-27T14:00:18.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.004+0000 7f1b862bb640 1 Processor -- start 2024-01-27T14:00:18.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.004+0000 7f1b862bb640 1 -- start start 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b862bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b800c7da0 0x7f1b8015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b862bb640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8015a8a0 con 0x7f1b80153db0 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b862bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b800c99d0 con 0x7f1b800cb1e0 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b862bb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b800cab10 con 0x7f1b800c7da0 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b7ffff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f1b80153db0 0x7f1b8006b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47462/0 (socket says 172.21.15.46:47462) 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b7ffff640 1 -- 172.21.15.46:0/4043954896 learned_addr learned my addr 172.21.15.46:0/4043954896 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:18.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.005+0000 7f1b84858640 1 --2- 172.21.15.46:0/4043954896 >> v2:172.21.15.78:3300/0 conn(0x7f1b800c7da0 0x7f1b8015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.008+0000 7f1b7effd640 1 -- 172.21.15.46:0/4043954896 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012733626 0 0) 0x7f1b68001110 con 0x7f1b80153db0 2024-01-27T14:00:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.008+0000 7f1b7effd640 1 -- 172.21.15.46:0/4043954896 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b6c003520 con 0x7f1b80153db0 2024-01-27T14:00:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.009+0000 7f1b84858640 1 -- 172.21.15.46:0/4043954896 >> v1:172.21.15.78:6789/0 conn(0x7f1b800cb1e0 legacy=0x7f1b800c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.009+0000 7f1b84858640 1 -- 172.21.15.46:0/4043954896 >> v1:172.21.15.46:6789/0 conn(0x7f1b80153db0 legacy=0x7f1b8006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:18.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.009+0000 7f1b84858640 1 -- 172.21.15.46:0/4043954896 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800c9c20 con 0x7f1b800c7da0 2024-01-27T14:00:18.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.012+0000 7f1b84858640 1 --2- 172.21.15.46:0/4043954896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015a360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009d90 tx=0x7f1b7802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28ad8a7f1009b2bc server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b7effd640 1 -- 172.21.15.46:0/4043954896 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7802cd00 con 0x7f1b800c7da0 2024-01-27T14:00:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b7effd640 1 -- 172.21.15.46:0/4043954896 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7802ce60 con 0x7f1b800c7da0 2024-01-27T14:00:19.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b7effd640 1 -- 172.21.15.46:0/4043954896 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78034660 con 0x7f1b800c7da0 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 -- 172.21.15.46:0/4043954896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 msgr2=0x7f1b8015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 --2- 172.21.15.46:0/4043954896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015a360 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009d90 tx=0x7f1b7802bf50 comp rx=0 tx=0).stop 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 -- 172.21.15.46:0/4043954896 shutdown_connections 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 --2- 172.21.15.46:0/4043954896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015a360 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 -- 172.21.15.46:0/4043954896 >> 172.21.15.46:0/4043954896 conn(0x7f1b800cf050 msgr2=0x7f1b800cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 -- 172.21.15.46:0/4043954896 shutdown_connections 2024-01-27T14:00:19.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.016+0000 7f1b862bb640 1 -- 172.21.15.46:0/4043954896 wait complete. 2024-01-27T14:00:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.017+0000 7f1b862bb640 1 Processor -- start 2024-01-27T14:00:19.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 -- start start 2024-01-27T14:00:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b800cb1e0 0x7f1b80140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 0x7f1b80141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b801e4780 con 0x7f1b80153db0 2024-01-27T14:00:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b801e4d80 con 0x7f1b800c7da0 2024-01-27T14:00:19.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.018+0000 7f1b862bb640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b801f2e70 con 0x7f1b800cb1e0 2024-01-27T14:00:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.019+0000 7f1b84858640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 0x7f1b80141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.019+0000 7f1b7f7fe640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b800cb1e0 0x7f1b80140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.019+0000 7f1b7ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.019+0000 7f1b84858640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 0x7f1b80141300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40896/0 (socket says 172.21.15.46:40896) 2024-01-27T14:00:19.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.019+0000 7f1b84858640 1 -- 172.21.15.46:0/3914011313 learned_addr learned my addr 172.21.15.46:0/3914011313 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.022+0000 7f1b84858640 1 -- 172.21.15.46:0/3914011313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b800cb1e0 msgr2=0x7f1b80140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.022+0000 7f1b84858640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b800cb1e0 0x7f1b80140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.022+0000 7f1b84858640 1 -- 172.21.15.46:0/3914011313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 msgr2=0x7f1b8015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.022+0000 7f1b84858640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.022+0000 7f1b84858640 1 -- 172.21.15.46:0/3914011313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78009a70 con 0x7f1b80153db0 2024-01-27T14:00:19.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.025+0000 7f1b84858640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 0x7f1b80141300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009d90 tx=0x7f1b78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.028+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7803d600 con 0x7f1b80153db0 2024-01-27T14:00:19.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.028+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7803d780 con 0x7f1b80153db0 2024-01-27T14:00:19.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.029+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7803db30 con 0x7f1b80153db0 2024-01-27T14:00:19.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.029+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b801e2dc0 con 0x7f1b80153db0 2024-01-27T14:00:19.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.029+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b801e3380 con 0x7f1b80153db0 2024-01-27T14:00:19.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.030+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b800c6f60 con 0x7f1b80153db0 2024-01-27T14:00:19.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.290+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1b7803b040 con 0x7f1b80153db0 2024-01-27T14:00:19.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.290+0000 7f1b7cff9640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b6006af50 0x7f1b6006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.290+0000 7f1b7ffff640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b6006af50 0x7f1b6006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.291+0000 7f1b7ffff640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b6006af50 0x7f1b6006d410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b68001270 tx=0x7f1b68007bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.303+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b7807acf0 con 0x7f1b80153db0 2024-01-27T14:00:19.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.303+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1b78077030 con 0x7f1b80153db0 2024-01-27T14:00:19.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.483+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b800ca4c0 con 0x7f1b6006af50 2024-01-27T14:00:19.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.484+0000 7f1b7cff9640 1 -- 172.21.15.46:0/3914011313 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b68005850 con 0x7f1b6006af50 2024-01-27T14:00:19.470 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 5 to deep-scrub 2024-01-27T14:00:19.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b6006af50 msgr2=0x7f1b6006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b6006af50 0x7f1b6006d410 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b68001270 tx=0x7f1b68007bb0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 msgr2=0x7f1b80141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 0x7f1b80141300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009d90 tx=0x7f1b78004a40 comp rx=0 tx=0).stop 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 shutdown_connections 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f1b6006af50 0x7f1b6006d410 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b80153db0 0x7f1b80141300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.485+0000 7f1b862bb640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f1b800cb1e0 0x7f1b80140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.486+0000 7f1b862bb640 1 --2- 172.21.15.46:0/3914011313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b800c7da0 0x7f1b8015b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.486+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 >> 172.21.15.46:0/3914011313 conn(0x7f1b800cf050 msgr2=0x7f1b801514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.486+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 shutdown_connections 2024-01-27T14:00:19.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.486+0000 7f1b862bb640 1 -- 172.21.15.46:0/3914011313 wait complete. 2024-01-27T14:00:19.483 INFO:tasks.ceph:Scrubbing osd.6 2024-01-27T14:00:19.483 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.603+0000 7fd74ea5d640 1 Processor -- start 2024-01-27T14:00:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.603+0000 7fd74ea5d640 1 -- start start 2024-01-27T14:00:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.604+0000 7fd74ea5d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7480ca0a0 0x7fd74806d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.604+0000 7fd74ea5d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd74815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.604+0000 7fd74ea5d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7480c5420 con 0x7fd7480ca480 2024-01-27T14:00:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.604+0000 7fd74ea5d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74815a800 con 0x7fd7480ca0a0 2024-01-27T14:00:19.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.604+0000 7fd74ea5d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480cac50 con 0x7fd748153d20 2024-01-27T14:00:19.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.612+0000 7fd747fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7480ca0a0 0x7fd74806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.613+0000 7fd747fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7480ca0a0 0x7fd74806d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56902/0 (socket says 172.21.15.46:56902) 2024-01-27T14:00:19.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.613+0000 7fd747fff640 1 -- 172.21.15.46:0/2660097281 learned_addr learned my addr 172.21.15.46:0/2660097281 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.616+0000 7fd74cffa640 1 --2- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd74815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.616+0000 7fd747fff640 1 -- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 msgr2=0x7fd74815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.616+0000 7fd747fff640 1 --2- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd74815a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.616+0000 7fd747fff640 1 -- 172.21.15.46:0/2660097281 >> v1:172.21.15.78:6789/0 conn(0x7fd7480ca480 legacy=0x7fd748153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:19.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.616+0000 7fd747fff640 1 -- 172.21.15.46:0/2660097281 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480c4340 con 0x7fd7480ca0a0 2024-01-27T14:00:19.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.620+0000 7fd747fff640 1 --2- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd74806d140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd738009870 tx=0x7fd73802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999c6cdc72eeb659 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd746ffd640 1 -- 172.21.15.46:0/2660097281 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738030840 con 0x7fd7480ca0a0 2024-01-27T14:00:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd746ffd640 1 -- 172.21.15.46:0/2660097281 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380309a0 con 0x7fd7480ca0a0 2024-01-27T14:00:19.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd746ffd640 1 -- 172.21.15.46:0/2660097281 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738030d30 con 0x7fd7480ca0a0 2024-01-27T14:00:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 -- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 msgr2=0x7fd74806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 --2- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd74806d140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd738009870 tx=0x7fd73802b980 comp rx=0 tx=0).stop 2024-01-27T14:00:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 -- 172.21.15.46:0/2660097281 shutdown_connections 2024-01-27T14:00:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 --2- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd74815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 --2- 172.21.15.46:0/2660097281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd74806d140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 -- 172.21.15.46:0/2660097281 >> 172.21.15.46:0/2660097281 conn(0x7fd74808b660 msgr2=0x7fd7480663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 -- 172.21.15.46:0/2660097281 shutdown_connections 2024-01-27T14:00:19.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.624+0000 7fd74ea5d640 1 -- 172.21.15.46:0/2660097281 wait complete. 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 Processor -- start 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 -- start start 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd7481528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7480ca480 0x7fd748155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd748156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748156a30 con 0x7fd7480ca480 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748157f70 con 0x7fd7480ca0a0 2024-01-27T14:00:19.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.626+0000 7fd74ea5d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd748157680 con 0x7fd748153d20 2024-01-27T14:00:19.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.627+0000 7fd74cffa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd748156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.627+0000 7fd747fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd7481528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.627+0000 7fd74cffa640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd748156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:42602/0 (socket says 172.21.15.46:42602) 2024-01-27T14:00:19.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.627+0000 7fd74cffa640 1 -- 172.21.15.46:0/402119535 learned_addr learned my addr 172.21.15.46:0/402119535 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:19.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.628+0000 7fd7477fe640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7480ca480 0x7fd748155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.631+0000 7fd747fff640 1 -- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 msgr2=0x7fd748156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.631+0000 7fd747fff640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd748153d20 0x7fd748156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.631+0000 7fd747fff640 1 -- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7480ca480 msgr2=0x7fd748155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.631+0000 7fd747fff640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd7480ca480 0x7fd748155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.631+0000 7fd747fff640 1 -- 172.21.15.46:0/402119535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094d0 con 0x7fd7480ca0a0 2024-01-27T14:00:19.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.633+0000 7fd747fff640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd7481528b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd738033000 tx=0x7fd738004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.635+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738039d60 con 0x7fd7480ca0a0 2024-01-27T14:00:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.635+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7481f0160 con 0x7fd7480ca0a0 2024-01-27T14:00:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.635+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748157c00 con 0x7fd7480ca0a0 2024-01-27T14:00:19.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.636+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7480c4b80 con 0x7fd7480ca0a0 2024-01-27T14:00:19.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.637+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73804d460 con 0x7fd7480ca0a0 2024-01-27T14:00:19.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.637+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73804d7d0 con 0x7fd7480ca0a0 2024-01-27T14:00:19.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.656+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd73804d930 con 0x7fd7480ca0a0 2024-01-27T14:00:19.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.657+0000 7fd744ff9640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd73406aed0 0x7fd73406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.657+0000 7fd7477fe640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd73406aed0 0x7fd73406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.657+0000 7fd7477fe640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd73406aed0 0x7fd73406d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd74815df20 tx=0x7fd73c007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.660+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd73803e070 con 0x7fd7480ca0a0 2024-01-27T14:00:19.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.660+0000 7fd744ff9640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7fd7340746b0 0x7fd734076b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.660+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 --> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd734077220 con 0x7fd7340746b0 2024-01-27T14:00:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.660+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd738077f00 con 0x7fd7480ca0a0 2024-01-27T14:00:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.660+0000 7fd74cffa640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7fd7340746b0 0x7fd734076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.661+0000 7fd74cffa640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7fd7340746b0 0x7fd734076b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.662+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== osd.6 v2:172.21.15.78:6800/2551716118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd734077220 con 0x7fd7340746b0 2024-01-27T14:00:19.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 --> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7480c48a0 con 0x7fd7340746b0 2024-01-27T14:00:19.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd744ff9640 1 -- 172.21.15.46:0/402119535 <== osd.6 v2:172.21.15.78:6800/2551716118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd74000f4c0 con 0x7fd7340746b0 2024-01-27T14:00:19.662 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:19.662 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:19.662 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7fd7340746b0 msgr2=0x7fd734076b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:6800/2551716118,v1:172.21.15.78:6801/2551716118] conn(0x7fd7340746b0 0x7fd734076b50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd73406aed0 msgr2=0x7fd73406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd73406aed0 0x7fd73406d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd74815df20 tx=0x7fd73c007e30 comp rx=0 tx=0).stop 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 msgr2=0x7fd7481528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74ea5d640 1 --2- 172.21.15.46:0/402119535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7480ca0a0 0x7fd7481528b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd738033000 tx=0x7fd738004730 comp rx=0 tx=0).stop 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.675+0000 7fd74cffa640 1 -- 172.21.15.46:0/402119535 reap_dead start 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.676+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 shutdown_connections 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.676+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 >> 172.21.15.46:0/402119535 conn(0x7fd74808b660 msgr2=0x7fd7480b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.676+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 shutdown_connections 2024-01-27T14:00:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.676+0000 7fd74ea5d640 1 -- 172.21.15.46:0/402119535 wait complete. 2024-01-27T14:00:19.672 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-27T14:00:19.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.788+0000 7fd690846640 1 Processor -- start 2024-01-27T14:00:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.788+0000 7fd690846640 1 -- start start 2024-01-27T14:00:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd690846640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd68c156fc0 0x7fd68c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd690846640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd690846640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c15cf70 con 0x7fd68c0717e0 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd690846640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c1573a0 con 0x7fd68c156fc0 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd690846640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c06c520 con 0x7fd68c0c7f10 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd683fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd68c0717e0 0x7fd68c0c7800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47468/0 (socket says 172.21.15.46:47468) 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.789+0000 7fd683fff640 1 -- 172.21.15.46:0/2238256727 learned_addr learned my addr 172.21.15.46:0/2238256727 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.790+0000 7fd68a59c640 1 --2- 172.21.15.46:0/2238256727 >> v2:172.21.15.78:3300/0 conn(0x7fd68c156fc0 0x7fd68c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.790+0000 7fd68ad9d640 1 --2- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.792+0000 7fd689d9b640 1 -- 172.21.15.46:0/2238256727 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848958205 0 0) 0x7fd68c15cf70 con 0x7fd68c0717e0 2024-01-27T14:00:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.792+0000 7fd689d9b640 1 -- 172.21.15.46:0/2238256727 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd678003520 con 0x7fd68c0717e0 2024-01-27T14:00:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.792+0000 7fd68a59c640 1 -- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 msgr2=0x7fd68c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.792+0000 7fd68a59c640 1 --2- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.792+0000 7fd68a59c640 1 -- 172.21.15.46:0/2238256727 >> v1:172.21.15.46:6789/0 conn(0x7fd68c0717e0 legacy=0x7fd68c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.792+0000 7fd68a59c640 1 -- 172.21.15.46:0/2238256727 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c06c800 con 0x7fd68c156fc0 2024-01-27T14:00:19.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.794+0000 7fd68a59c640 1 --2- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c156fc0 0x7fd68c0712a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0097a0 tx=0x7fd67c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15765f0ac6da71d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.798+0000 7fd689d9b640 1 -- 172.21.15.46:0/2238256727 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c031830 con 0x7fd68c156fc0 2024-01-27T14:00:19.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.798+0000 7fd689d9b640 1 -- 172.21.15.46:0/2238256727 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c031990 con 0x7fd68c156fc0 2024-01-27T14:00:19.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.798+0000 7fd689d9b640 1 -- 172.21.15.46:0/2238256727 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c031d20 con 0x7fd68c156fc0 2024-01-27T14:00:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 -- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c156fc0 msgr2=0x7fd68c0712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 --2- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c156fc0 0x7fd68c0712a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0097a0 tx=0x7fd67c02b8d0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 -- 172.21.15.46:0/2238256727 shutdown_connections 2024-01-27T14:00:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 --2- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 --2- 172.21.15.46:0/2238256727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c156fc0 0x7fd68c0712a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 -- 172.21.15.46:0/2238256727 >> 172.21.15.46:0/2238256727 conn(0x7fd68c06f310 msgr2=0x7fd68c06f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 -- 172.21.15.46:0/2238256727 shutdown_connections 2024-01-27T14:00:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.799+0000 7fd690846640 1 -- 172.21.15.46:0/2238256727 wait complete. 2024-01-27T14:00:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.800+0000 7fd690846640 1 Processor -- start 2024-01-27T14:00:19.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 -- start start 2024-01-27T14:00:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c0717e0 0x7fd68c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 0x7fd68c1e2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c152380 con 0x7fd68c156fc0 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1ef420 con 0x7fd68c0717e0 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.801+0000 7fd690846640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1ef700 con 0x7fd68c0c7f10 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.802+0000 7fd68ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 0x7fd68c1e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.802+0000 7fd68a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c0717e0 0x7fd68c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.802+0000 7fd68ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 0x7fd68c1e2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40904/0 (socket says 172.21.15.46:40904) 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.802+0000 7fd68ad9d640 1 -- 172.21.15.46:0/2203223089 learned_addr learned my addr 172.21.15.46:0/2203223089 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:19.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.802+0000 7fd683fff640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.805+0000 7fd68ad9d640 1 -- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 msgr2=0x7fd68c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.805+0000 7fd68ad9d640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.805+0000 7fd68ad9d640 1 -- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c0717e0 msgr2=0x7fd68c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.805+0000 7fd68ad9d640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c0717e0 0x7fd68c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:19.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.805+0000 7fd68ad9d640 1 -- 172.21.15.46:0/2203223089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009400 con 0x7fd68c156fc0 2024-01-27T14:00:19.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.808+0000 7fd68ad9d640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 0x7fd68c1e2670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd68400ef90 tx=0x7fd68400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:19.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.810+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684009ca0 con 0x7fd68c156fc0 2024-01-27T14:00:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.810+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c1ef9e0 con 0x7fd68c156fc0 2024-01-27T14:00:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.810+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c1effa0 con 0x7fd68c156fc0 2024-01-27T14:00:19.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:19.811+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c1574e0 con 0x7fd68c156fc0 2024-01-27T14:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.073+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68400f040 con 0x7fd68c156fc0 2024-01-27T14:00:20.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.073+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6840146a0 con 0x7fd68c156fc0 2024-01-27T14:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.074+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd684014880 con 0x7fd68c156fc0 2024-01-27T14:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.074+0000 7fd682ffd640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd66c06af00 0x7fd66c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.074+0000 7fd68a59c640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd66c06af00 0x7fd66c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.075+0000 7fd68a59c640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd66c06af00 0x7fd66c06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd67c036000 tx=0x7fd67c03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.090+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd684059640 con 0x7fd68c156fc0 2024-01-27T14:00:20.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.090+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd684055980 con 0x7fd68c156fc0 2024-01-27T14:00:20.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.272+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd68c0cd230 con 0x7fd66c06af00 2024-01-27T14:00:20.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.273+0000 7fd682ffd640 1 -- 172.21.15.46:0/2203223089 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd68c0cd230 con 0x7fd66c06af00 2024-01-27T14:00:20.259 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 6 to deep-scrub 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd66c06af00 msgr2=0x7fd66c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd66c06af00 0x7fd66c06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd67c036000 tx=0x7fd67c03c040 comp rx=0 tx=0).stop 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 msgr2=0x7fd68c1e2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 0x7fd68c1e2670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd68400ef90 tx=0x7fd68400c490 comp rx=0 tx=0).stop 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 shutdown_connections 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd66c06af00 0x7fd66c06d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd68c156fc0 0x7fd68c1e2670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd68c0c7f10 0x7fd68c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 --2- 172.21.15.46:0/2203223089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd68c0717e0 0x7fd68c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 >> 172.21.15.46:0/2203223089 conn(0x7fd68c06f310 msgr2=0x7fd68c155620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:20.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 shutdown_connections 2024-01-27T14:00:20.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.275+0000 7fd690846640 1 -- 172.21.15.46:0/2203223089 wait complete. 2024-01-27T14:00:20.273 INFO:tasks.ceph:Scrubbing osd.7 2024-01-27T14:00:20.273 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-27T14:00:20.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.394+0000 7f5eeb143640 1 Processor -- start 2024-01-27T14:00:20.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.394+0000 7f5eeb143640 1 -- start start 2024-01-27T14:00:20.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.395+0000 7f5eeb143640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.395+0000 7f5eeb143640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ee4153c00 0x7f5ee40ca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.395+0000 7f5eeb143640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee40cac90 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.395+0000 7f5eeb143640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee40c9f40 con 0x7f5ee4153c00 2024-01-27T14:00:20.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.395+0000 7f5eeb143640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee415cc90 con 0x7f5ee40cbbe0 2024-01-27T14:00:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.396+0000 7f5ee96e0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f5ee4153c00 0x7f5ee40ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.396+0000 7f5ee8edf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.396+0000 7f5ee3fff640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f5ee40cbfc0 0x7f5ee41534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:47484/0 (socket says 172.21.15.46:47484) 2024-01-27T14:00:20.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.396+0000 7f5ee3fff640 1 -- 172.21.15.46:0/2192817052 learned_addr learned my addr 172.21.15.46:0/2192817052 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.399+0000 7f5ee96e0640 1 -- 172.21.15.46:0/2192817052 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 msgr2=0x7f5ee40c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.399+0000 7f5ee96e0640 1 --2- 172.21.15.46:0/2192817052 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee40c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.399+0000 7f5ee96e0640 1 -- 172.21.15.46:0/2192817052 >> v1:172.21.15.46:6789/0 conn(0x7f5ee40cbfc0 legacy=0x7f5ee41534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.399+0000 7f5ee96e0640 1 -- 172.21.15.46:0/2192817052 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee415daf0 con 0x7f5ee4153c00 2024-01-27T14:00:20.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.403+0000 7f5ee96e0640 1 --2- 172.21.15.46:0/2192817052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 0x7f5ee40ca750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40097a0 tx=0x7f5ed402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e04e75a8fcf8649 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.407+0000 7f5ee37fe640 1 -- 172.21.15.46:0/2192817052 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4031830 con 0x7f5ee4153c00 2024-01-27T14:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.407+0000 7f5ee37fe640 1 -- 172.21.15.46:0/2192817052 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4031990 con 0x7f5ee4153c00 2024-01-27T14:00:20.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.407+0000 7f5ee37fe640 1 -- 172.21.15.46:0/2192817052 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4031d20 con 0x7f5ee4153c00 2024-01-27T14:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 -- 172.21.15.46:0/2192817052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 msgr2=0x7f5ee40ca750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 --2- 172.21.15.46:0/2192817052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 0x7f5ee40ca750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40097a0 tx=0x7f5ed402b8d0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 -- 172.21.15.46:0/2192817052 shutdown_connections 2024-01-27T14:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 --2- 172.21.15.46:0/2192817052 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 0x7f5ee40ca750 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 --2- 172.21.15.46:0/2192817052 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 -- 172.21.15.46:0/2192817052 >> 172.21.15.46:0/2192817052 conn(0x7f5ee408b600 msgr2=0x7f5ee40663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 -- 172.21.15.46:0/2192817052 shutdown_connections 2024-01-27T14:00:20.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.408+0000 7f5eeb143640 1 -- 172.21.15.46:0/2192817052 wait complete. 2024-01-27T14:00:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.410+0000 7f5eeb143640 1 Processor -- start 2024-01-27T14:00:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.410+0000 7f5eeb143640 1 -- start start 2024-01-27T14:00:20.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.411+0000 7f5eeb143640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee4147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.411+0000 7f5eeb143640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee40cbfc0 0x7f5ee41438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.411+0000 7f5eeb143640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 0x7f5ee4143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.411+0000 7f5eeb143640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40cf650 con 0x7f5ee4153c00 2024-01-27T14:00:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.411+0000 7f5eeb143640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee4143080 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.411+0000 7f5eeb143640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee40cf2e0 con 0x7f5ee40cbbe0 2024-01-27T14:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.412+0000 7f5ee8edf640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee4147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.412+0000 7f5ee3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee40cbfc0 0x7f5ee41438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.412+0000 7f5ee3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee40cbfc0 0x7f5ee41438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56936/0 (socket says 172.21.15.46:56936) 2024-01-27T14:00:20.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.412+0000 7f5ee3fff640 1 -- 172.21.15.46:0/3773436082 learned_addr learned my addr 172.21.15.46:0/3773436082 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:20.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.414+0000 7f5ee96e0640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 0x7f5ee4143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.416+0000 7f5ee3fff640 1 -- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 msgr2=0x7f5ee4147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.416+0000 7f5ee3fff640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f5ee40cbbe0 0x7f5ee4147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.416+0000 7f5ee3fff640 1 -- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 msgr2=0x7f5ee4143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.416+0000 7f5ee3fff640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ee4153c00 0x7f5ee4143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.416+0000 7f5ee3fff640 1 -- 172.21.15.46:0/3773436082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009400 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.418+0000 7f5ee3fff640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee40cbfc0 0x7f5ee41438c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c400 tx=0x7f5ed800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.420+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8005ce0 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.420+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee40cf000 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.420+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee40b35b0 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.421+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ee40b30c0 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.422+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee40b30c0 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.422+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8007270 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.442+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5ed80073d0 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.442+0000 7f5ee17fa640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5ed006aed0 0x7f5ed006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.443+0000 7f5ee8edf640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5ed006aed0 0x7f5ed006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.443+0000 7f5ee8edf640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5ed006aed0 0x7f5ed006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5edc011340 tx=0x7f5edc00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.445+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ed8005e40 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.445+0000 7f5ee17fa640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f5ed00746a0 0x7f5ed0076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.445+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 --> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ed0077210 con 0x7f5ed00746a0 2024-01-27T14:00:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.445+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed8054350 con 0x7f5ee40cbfc0 2024-01-27T14:00:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.446+0000 7f5ee96e0640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f5ed00746a0 0x7f5ed0076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.446+0000 7f5ee96e0640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f5ed00746a0 0x7f5ed0076b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.447+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== osd.7 v2:172.21.15.78:6809/3083867566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5ed0077210 con 0x7f5ed00746a0 2024-01-27T14:00:20.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 --> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ee415d1c0 con 0x7f5ed00746a0 2024-01-27T14:00:20.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5ee17fa640 1 -- 172.21.15.46:0/3773436082 <== osd.7 v2:172.21.15.78:6809/3083867566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5ed4031b00 con 0x7f5ed00746a0 2024-01-27T14:00:20.448 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-01-27T14:00:20.448 INFO:teuthology.orchestra.run.smithi046.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-27T14:00:20.448 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-01-27T14:00:20.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f5ed00746a0 msgr2=0x7f5ed0076b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:6809/3083867566,v1:172.21.15.78:6811/3083867566] conn(0x7f5ed00746a0 0x7f5ed0076b40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5ed006aed0 msgr2=0x7f5ed006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f5ed006aed0 0x7f5ed006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5edc011340 tx=0x7f5edc00b040 comp rx=0 tx=0).stop 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee40cbfc0 msgr2=0x7f5ee41438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5eeb143640 1 --2- 172.21.15.46:0/3773436082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ee40cbfc0 0x7f5ee41438c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800c400 tx=0x7f5ed800c8c0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.461+0000 7f5ee96e0640 1 -- 172.21.15.46:0/3773436082 reap_dead start 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.462+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 shutdown_connections 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.462+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 >> 172.21.15.46:0/3773436082 conn(0x7f5ee408b600 msgr2=0x7f5ee4152120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.462+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 shutdown_connections 2024-01-27T14:00:20.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.462+0000 7f5eeb143640 1 -- 172.21.15.46:0/3773436082 wait complete. 2024-01-27T14:00:20.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-27T14:00:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.578+0000 7f05c511d640 1 Processor -- start 2024-01-27T14:00:20.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.578+0000 7f05c511d640 1 -- start start 2024-01-27T14:00:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.579+0000 7f05c511d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05c00c1c20 0x7f05c0150120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.579+0000 7f05c511d640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c015a770 con 0x7f05c0159c80 2024-01-27T14:00:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.579+0000 7f05c511d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c006e1e0 con 0x7f05c0156f20 2024-01-27T14:00:20.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.579+0000 7f05c511d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c006ed60 con 0x7f05c00c1c20 2024-01-27T14:00:20.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.581+0000 7f05bf59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05c00c1c20 0x7f05c0150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.581+0000 7f05bf59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05c00c1c20 0x7f05c0150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56944/0 (socket says 172.21.15.46:56944) 2024-01-27T14:00:20.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.581+0000 7f05bf59e640 1 -- 172.21.15.46:0/2397007859 learned_addr learned my addr 172.21.15.46:0/2397007859 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:20.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.585+0000 7f05bf59e640 1 -- 172.21.15.46:0/2397007859 >> v1:172.21.15.78:6789/0 conn(0x7f05c0156f20 legacy=0x7f05c00c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.585+0000 7f05bf59e640 1 -- 172.21.15.46:0/2397007859 >> v1:172.21.15.46:6789/0 conn(0x7f05c0159c80 legacy=0x7f05c015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:20.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.585+0000 7f05bf59e640 1 -- 172.21.15.46:0/2397007859 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c006e4c0 con 0x7f05c00c1c20 2024-01-27T14:00:20.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.631+0000 7f05bf59e640 1 --2- 172.21.15.46:0/2397007859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c00c1c20 0x7f05c0150120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05b800d180 tx=0x7f05b802e160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fed40f2e2d1e41d server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.639+0000 7f05be59c640 1 -- 172.21.15.46:0/2397007859 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800b0d0 con 0x7f05c00c1c20 2024-01-27T14:00:20.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05be59c640 1 -- 172.21.15.46:0/2397007859 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800b230 con 0x7f05c00c1c20 2024-01-27T14:00:20.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05be59c640 1 -- 172.21.15.46:0/2397007859 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8009600 con 0x7f05c00c1c20 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 -- 172.21.15.46:0/2397007859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c00c1c20 msgr2=0x7f05c0150120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 --2- 172.21.15.46:0/2397007859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c00c1c20 0x7f05c0150120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05b800d180 tx=0x7f05b802e160 comp rx=0 tx=0).stop 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 -- 172.21.15.46:0/2397007859 shutdown_connections 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 --2- 172.21.15.46:0/2397007859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c00c1c20 0x7f05c0150120 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 -- 172.21.15.46:0/2397007859 >> 172.21.15.46:0/2397007859 conn(0x7f05c00c89a0 msgr2=0x7f05c00c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 -- 172.21.15.46:0/2397007859 shutdown_connections 2024-01-27T14:00:20.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.640+0000 7f05c511d640 1 -- 172.21.15.46:0/2397007859 wait complete. 2024-01-27T14:00:20.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.642+0000 7f05c511d640 1 Processor -- start 2024-01-27T14:00:20.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.642+0000 7f05c511d640 1 -- start start 2024-01-27T14:00:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05c511d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 0x7f05c00c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05c511d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05c0156f20 0x7f05c00cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05c511d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c0159c80 0x7f05c01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05c511d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00ca660 con 0x7f05c00c1c20 2024-01-27T14:00:20.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05c511d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c70e0 con 0x7f05c0159c80 2024-01-27T14:00:20.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05c511d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01576a0 con 0x7f05c0156f20 2024-01-27T14:00:20.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.643+0000 7f05bed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 0x7f05c00c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.644+0000 7f05b659c640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05c0156f20 0x7f05c00cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.644+0000 7f05bed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 0x7f05c00c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40932/0 (socket says 172.21.15.46:40932) 2024-01-27T14:00:20.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.644+0000 7f05bed9d640 1 -- 172.21.15.46:0/2298000454 learned_addr learned my addr 172.21.15.46:0/2298000454 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:20.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.645+0000 7f05bf59e640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c0159c80 0x7f05c01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.647+0000 7f05bed9d640 1 -- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05c0156f20 msgr2=0x7f05c00cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.647+0000 7f05bed9d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05c0156f20 0x7f05c00cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.647+0000 7f05bed9d640 1 -- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c0159c80 msgr2=0x7f05c01585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.647+0000 7f05bed9d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c0159c80 0x7f05c01585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:20.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.647+0000 7f05bed9d640 1 -- 172.21.15.46:0/2298000454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b800bd40 con 0x7f05c00c1c20 2024-01-27T14:00:20.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.652+0000 7f05bed9d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 0x7f05c00c6ba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b3e0 tx=0x7f05b000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.709+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0011830 con 0x7f05c00c1c20 2024-01-27T14:00:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.709+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b00119b0 con 0x7f05c00c1c20 2024-01-27T14:00:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.710+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c0157980 con 0x7f05c00c1c20 2024-01-27T14:00:20.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.710+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0011d60 con 0x7f05c00c1c20 2024-01-27T14:00:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.710+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c00ca8c0 con 0x7f05c00c1c20 2024-01-27T14:00:20.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.711+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c00caae0 con 0x7f05c00c1c20 2024-01-27T14:00:20.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.970+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f05b001a400 con 0x7f05c00c1c20 2024-01-27T14:00:20.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.971+0000 7f05b7fff640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f05a006af50 0x7f05a006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:20.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.971+0000 7f05b659c640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f05a006af50 0x7f05a006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:20.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.971+0000 7f05b659c640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f05a006af50 0x7f05a006d410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05c00c1a10 tx=0x7f05a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:20.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.986+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f05b0058880 con 0x7f05c00c1c20 2024-01-27T14:00:20.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:20.986+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f05b00b5190 con 0x7f05c00c1c20 2024-01-27T14:00:21.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.167+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c014eb80 con 0x7f05a006af50 2024-01-27T14:00:21.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.167+0000 7f05b7fff640 1 -- 172.21.15.46:0/2298000454 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05c014eb80 con 0x7f05a006af50 2024-01-27T14:00:21.154 INFO:teuthology.orchestra.run.smithi046.stderr:instructed osd(s) 7 to deep-scrub 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f05a006af50 msgr2=0x7f05a006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f05a006af50 0x7f05a006d410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05c00c1a10 tx=0x7f05a8009040 comp rx=0 tx=0).stop 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 msgr2=0x7f05c00c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 0x7f05c00c6ba0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05b000b3e0 tx=0x7f05b000b8a0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 shutdown_connections 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f05a006af50 0x7f05a006d410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c0159c80 0x7f05c01585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f05c0156f20 0x7f05c00cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 --2- 172.21.15.46:0/2298000454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05c00c1c20 0x7f05c00c6ba0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 >> 172.21.15.46:0/2298000454 conn(0x7f05c00c89a0 msgr2=0x7f05c014e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 shutdown_connections 2024-01-27T14:00:21.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.169+0000 7f05c511d640 1 -- 172.21.15.46:0/2298000454 wait complete. 2024-01-27T14:00:21.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:00:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.282+0000 7f7d55e2b640 1 Processor -- start 2024-01-27T14:00:21.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.282+0000 7f7d55e2b640 1 -- start start 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d55e2b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d50153ca0 0x7f7d500c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d55e2b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d500c5b00 0x7f7d500c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d55e2b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5015a280 con 0x7f7d500c4750 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d55e2b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500c5f70 con 0x7f7d50153ca0 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d55e2b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d500c6750 con 0x7f7d500c5b00 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d4f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d50153ca0 0x7f7d500c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d4ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7d500c5b00 0x7f7d500c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d4f7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f7d50153ca0 0x7f7d500c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40938/0 (socket says 172.21.15.46:40938) 2024-01-27T14:00:21.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.283+0000 7f7d4f7fe640 1 -- 172.21.15.46:0/3859638326 learned_addr learned my addr 172.21.15.46:0/3859638326 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.286+0000 7f7d4f7fe640 1 -- 172.21.15.46:0/3859638326 >> v2:172.21.15.78:3300/0 conn(0x7f7d500c5b00 msgr2=0x7f7d500c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.286+0000 7f7d4f7fe640 1 --2- 172.21.15.46:0/3859638326 >> v2:172.21.15.78:3300/0 conn(0x7f7d500c5b00 0x7f7d500c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.286+0000 7f7d4f7fe640 1 -- 172.21.15.46:0/3859638326 >> v1:172.21.15.78:6789/0 conn(0x7f7d500c4750 legacy=0x7f7d5006bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:21.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.286+0000 7f7d4f7fe640 1 -- 172.21.15.46:0/3859638326 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5015a790 con 0x7f7d50153ca0 2024-01-27T14:00:21.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.288+0000 7f7d4f7fe640 1 --2- 172.21.15.46:0/3859638326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d50153ca0 0x7f7d500c41b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d5008b060 tx=0x7f7d4002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110632239772fbe0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.295+0000 7f7d4e7fc640 1 -- 172.21.15.46:0/3859638326 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40030860 con 0x7f7d50153ca0 2024-01-27T14:00:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.295+0000 7f7d4e7fc640 1 -- 172.21.15.46:0/3859638326 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d400309c0 con 0x7f7d50153ca0 2024-01-27T14:00:21.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.295+0000 7f7d4e7fc640 1 -- 172.21.15.46:0/3859638326 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40030d50 con 0x7f7d50153ca0 2024-01-27T14:00:21.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 -- 172.21.15.46:0/3859638326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d50153ca0 msgr2=0x7f7d500c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/3859638326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d50153ca0 0x7f7d500c41b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d5008b060 tx=0x7f7d4002b9a0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 -- 172.21.15.46:0/3859638326 shutdown_connections 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/3859638326 >> v2:172.21.15.78:3300/0 conn(0x7f7d500c5b00 0x7f7d500c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/3859638326 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d50153ca0 0x7f7d500c41b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 -- 172.21.15.46:0/3859638326 >> 172.21.15.46:0/3859638326 conn(0x7f7d500cf230 msgr2=0x7f7d500cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 -- 172.21.15.46:0/3859638326 shutdown_connections 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.296+0000 7f7d55e2b640 1 -- 172.21.15.46:0/3859638326 wait complete. 2024-01-27T14:00:21.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.297+0000 7f7d55e2b640 1 Processor -- start 2024-01-27T14:00:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.297+0000 7f7d55e2b640 1 -- start start 2024-01-27T14:00:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.298+0000 7f7d55e2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d500c4750 0x7f7d501f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.298+0000 7f7d55e2b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d500c5b00 0x7f7d5014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:21.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.298+0000 7f7d55e2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 0x7f7d50157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.298+0000 7f7d55e2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d50159920 con 0x7f7d500c4750 2024-01-27T14:00:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.298+0000 7f7d55e2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d501479e0 con 0x7f7d50153ca0 2024-01-27T14:00:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.298+0000 7f7d55e2b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d501f0c50 con 0x7f7d500c5b00 2024-01-27T14:00:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.299+0000 7f7d4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 0x7f7d50157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.299+0000 7f7d4effd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d500c5b00 0x7f7d5014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:21.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.299+0000 7f7d4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 0x7f7d50157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:56962/0 (socket says 172.21.15.46:56962) 2024-01-27T14:00:21.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.299+0000 7f7d4ffff640 1 -- 172.21.15.46:0/852625661 learned_addr learned my addr 172.21.15.46:0/852625661 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:21.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.301+0000 7f7d4f7fe640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d500c4750 0x7f7d501f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.304+0000 7f7d4ffff640 1 -- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d500c5b00 msgr2=0x7f7d5014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.304+0000 7f7d4ffff640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d500c5b00 0x7f7d5014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.304+0000 7f7d4ffff640 1 -- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d500c4750 msgr2=0x7f7d501f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.304+0000 7f7d4ffff640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d500c4750 0x7f7d501f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.304+0000 7f7d4ffff640 1 -- 172.21.15.46:0/852625661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400094d0 con 0x7f7d50153ca0 2024-01-27T14:00:21.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.307+0000 7f7d4ffff640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 0x7f7d50157b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009d30 tx=0x7f7d4800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:21.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.311+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48009ba0 con 0x7f7d50153ca0 2024-01-27T14:00:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.311+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800f040 con 0x7f7d50153ca0 2024-01-27T14:00:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.311+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d50157690 con 0x7f7d50153ca0 2024-01-27T14:00:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.311+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480146c0 con 0x7f7d50153ca0 2024-01-27T14:00:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.311+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d50159080 con 0x7f7d50153ca0 2024-01-27T14:00:21.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.312+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d50157460 con 0x7f7d50153ca0 2024-01-27T14:00:21.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.560+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7d48014820 con 0x7f7d50153ca0 2024-01-27T14:00:21.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.561+0000 7f7d37fff640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7d3c06af50 0x7f7d3c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:21.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.561+0000 7f7d4f7fe640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7d3c06af50 0x7f7d3c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:21.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.561+0000 7f7d4f7fe640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7d3c06af50 0x7f7d3c06d410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d40036000 tx=0x7f7d40008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:21.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.564+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d480592e0 con 0x7f7d50153ca0 2024-01-27T14:00:21.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.578+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7d48055620 con 0x7f7d50153ca0 2024-01-27T14:00:21.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.763+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d500c4d40 con 0x7f7d3c06af50 2024-01-27T14:00:21.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.772+0000 7f7d37fff640 1 -- 172.21.15.46:0/852625661 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369326 (secure 0 0 0) 0x7f7d40030660 con 0x7f7d3c06af50 2024-01-27T14:00:21.762 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:21.764 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:00:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7d3c06af50 msgr2=0x7f7d3c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7d3c06af50 0x7f7d3c06d410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7d40036000 tx=0x7f7d40008030 comp rx=0 tx=0).stop 2024-01-27T14:00:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 msgr2=0x7f7d50157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:21.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 0x7f7d50157b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009d30 tx=0x7f7d4800c490 comp rx=0 tx=0).stop 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 shutdown_connections 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f7d3c06af50 0x7f7d3c06d410 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7d50153ca0 0x7f7d50157b20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f7d500c5b00 0x7f7d5014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 --2- 172.21.15.46:0/852625661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d500c4750 0x7f7d501f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 >> 172.21.15.46:0/852625661 conn(0x7f7d500cf230 msgr2=0x7f7d500cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 shutdown_connections 2024-01-27T14:00:21.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:21.775+0000 7f7d55e2b640 1 -- 172.21.15.46:0/852625661 wait complete. 2024-01-27T14:00:21.773 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":873,"stamp":"2024-01-27T14:00:19.950344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38431928,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1007,"num_read_kb":1043,"num_write":12365,"num_write_kb":342097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14538,"ondisk_log_size":14538,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397984,"kb_used_data":52832,"kb_used_omap":12,"kb_used_meta":345075,"kb_avail":754576736,"statfs":{"total":773094113280,"available":772686577664,"internally_reserved":0,"allocated":54099968,"data_stored":77794048,"data_compressed":7048892,"data_compressed_allocated":10846208,"data_compressed_original":35938304,"omap_allocated":12752,"internal_metadata":353357360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":848,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002873"},"pg_stats":[{"pgid":"2.1f","version":"27'626","reported_seq":674,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:16.655207+0000","last_change":"2024-01-27T14:00:16.655230+0000","last_active":"2024-01-27T14:00:16.655207+0000","last_peered":"2024-01-27T14:00:16.655207+0000","last_clean":"2024-01-27T14:00:16.655207+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T14:00:16.655207+0000","last_undegraded":"2024-01-27T14:00:16.655207+0000","last_fullsized":"2024-01-27T14:00:16.655207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'626","last_scrub_stamp":"2024-01-27T14:00:16.655152+0000","last_deep_scrub":"27'626","last_deep_scrub_stamp":"2024-01-27T14:00:16.655152+0000","last_clean_scrub_stamp":"2024-01-27T14:00:16.655152+0000","objects_scrubbed":3,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:08:41.959669+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'26","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.902303+0000","last_change":"2024-01-27T13:32:13.636092+0000","last_active":"2024-01-27T14:00:17.902303+0000","last_peered":"2024-01-27T14:00:17.902303+0000","last_clean":"2024-01-27T14:00:17.902303+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T14:00:17.902303+0000","last_undegraded":"2024-01-27T14:00:17.902303+0000","last_fullsized":"2024-01-27T14:00:17.902303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'150","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.982750+0000","last_change":"2024-01-27T13:32:18.347109+0000","last_active":"2024-01-27T13:59:33.982750+0000","last_peered":"2024-01-27T13:59:33.982750+0000","last_clean":"2024-01-27T13:59:33.982750+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T13:59:33.982750+0000","last_undegraded":"2024-01-27T13:59:33.982750+0000","last_fullsized":"2024-01-27T13:59:33.982750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'716","reported_seq":757,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.902229+0000","last_change":"2024-01-27T13:32:12.337870+0000","last_active":"2024-01-27T14:00:17.902229+0000","last_peered":"2024-01-27T14:00:17.902229+0000","last_clean":"2024-01-27T14:00:17.902229+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T14:00:17.902229+0000","last_undegraded":"2024-01-27T14:00:17.902229+0000","last_fullsized":"2024-01-27T14:00:17.902229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'37","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:15.662705+0000","last_change":"2024-01-27T14:00:15.662728+0000","last_active":"2024-01-27T14:00:15.662705+0000","last_peered":"2024-01-27T14:00:15.662705+0000","last_clean":"2024-01-27T14:00:15.662705+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T14:00:15.662705+0000","last_undegraded":"2024-01-27T14:00:15.662705+0000","last_fullsized":"2024-01-27T14:00:15.662705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-01-27T14:00:15.662636+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-01-27T14:00:15.662636+0000","last_clean_scrub_stamp":"2024-01-27T14:00:15.662636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:49:08.129681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'132","reported_seq":161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787902+0000","last_change":"2024-01-27T13:32:18.090868+0000","last_active":"2024-01-27T13:59:30.787902+0000","last_peered":"2024-01-27T13:59:30.787902+0000","last_clean":"2024-01-27T13:59:30.787902+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T13:59:30.787902+0000","last_undegraded":"2024-01-27T13:59:30.787902+0000","last_fullsized":"2024-01-27T13:59:30.787902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:55:03.739948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1388","reported_seq":1425,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.618629+0000","last_change":"2024-01-27T13:32:12.380173+0000","last_active":"2024-01-27T13:59:53.618629+0000","last_peered":"2024-01-27T13:59:53.618629+0000","last_clean":"2024-01-27T13:59:53.618629+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T13:59:53.618629+0000","last_undegraded":"2024-01-27T13:59:53.618629+0000","last_fullsized":"2024-01-27T13:59:53.618629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1388,"log_dups_size":0,"ondisk_log_size":1388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:28.155934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'26","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059839+0000","last_change":"2024-01-27T13:32:13.639125+0000","last_active":"2024-01-27T14:00:05.059839+0000","last_peered":"2024-01-27T14:00:05.059839+0000","last_clean":"2024-01-27T14:00:05.059839+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T14:00:05.059839+0000","last_undegraded":"2024-01-27T14:00:05.059839+0000","last_fullsized":"2024-01-27T14:00:05.059839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:19:19.748568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'121","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.998050+0000","last_change":"2024-01-27T13:32:18.089932+0000","last_active":"2024-01-27T13:59:33.998050+0000","last_peered":"2024-01-27T13:59:33.998050+0000","last_clean":"2024-01-27T13:59:33.998050+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T13:59:33.998050+0000","last_undegraded":"2024-01-27T13:59:33.998050+0000","last_fullsized":"2024-01-27T13:59:33.998050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:17.068292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:45.339471+0000","last_change":"2024-01-27T13:32:12.375283+0000","last_active":"2024-01-27T13:59:45.339471+0000","last_peered":"2024-01-27T13:59:45.339471+0000","last_clean":"2024-01-27T13:59:45.339471+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T13:59:45.339471+0000","last_undegraded":"2024-01-27T13:59:45.339471+0000","last_fullsized":"2024-01-27T13:59:45.339471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'46","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.021532+0000","last_change":"2024-01-27T13:32:13.638685+0000","last_active":"2024-01-27T14:00:05.021532+0000","last_peered":"2024-01-27T14:00:05.021532+0000","last_clean":"2024-01-27T14:00:05.021532+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T14:00:05.021532+0000","last_undegraded":"2024-01-27T14:00:05.021532+0000","last_fullsized":"2024-01-27T14:00:05.021532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:20:30.260738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'126","reported_seq":155,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.124660+0000","last_change":"2024-01-27T13:32:18.092255+0000","last_active":"2024-01-27T13:59:32.124660+0000","last_peered":"2024-01-27T13:59:32.124660+0000","last_clean":"2024-01-27T13:59:32.124660+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T13:59:32.124660+0000","last_undegraded":"2024-01-27T13:59:32.124660+0000","last_fullsized":"2024-01-27T13:59:32.124660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:26.809814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085606+0000","last_change":"2024-01-27T13:32:13.639289+0000","last_active":"2024-01-27T14:00:05.085606+0000","last_peered":"2024-01-27T14:00:05.085606+0000","last_clean":"2024-01-27T14:00:05.085606+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T14:00:05.085606+0000","last_undegraded":"2024-01-27T14:00:05.085606+0000","last_fullsized":"2024-01-27T14:00:05.085606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:20:53.522872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'617","reported_seq":655,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617302+0000","last_change":"2024-01-27T13:32:12.382055+0000","last_active":"2024-01-27T13:59:53.617302+0000","last_peered":"2024-01-27T13:59:53.617302+0000","last_clean":"2024-01-27T13:59:53.617302+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T13:59:53.617302+0000","last_undegraded":"2024-01-27T13:59:53.617302+0000","last_fullsized":"2024-01-27T13:59:53.617302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":617,"log_dups_size":0,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:06:19.349608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'102","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:27.902717+0000","last_change":"2024-01-27T13:32:51.707357+0000","last_active":"2024-01-27T13:59:27.902717+0000","last_peered":"2024-01-27T13:59:27.902717+0000","last_clean":"2024-01-27T13:59:27.902717+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T13:59:27.902717+0000","last_undegraded":"2024-01-27T13:59:27.902717+0000","last_fullsized":"2024-01-27T13:59:27.902717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:36:27.470407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'35","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.011824+0000","last_change":"2024-01-27T13:32:13.636302+0000","last_active":"2024-01-27T14:00:05.011824+0000","last_peered":"2024-01-27T14:00:05.011824+0000","last_clean":"2024-01-27T14:00:05.011824+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T14:00:05.011824+0000","last_undegraded":"2024-01-27T14:00:05.011824+0000","last_fullsized":"2024-01-27T14:00:05.011824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.568649+0000","last_change":"2024-01-27T14:00:19.568672+0000","last_active":"2024-01-27T14:00:19.568649+0000","last_peered":"2024-01-27T14:00:19.568649+0000","last_clean":"2024-01-27T14:00:19.568649+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T14:00:19.568649+0000","last_undegraded":"2024-01-27T14:00:19.568649+0000","last_fullsized":"2024-01-27T14:00:19.568649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-01-27T14:00:19.568581+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-01-27T14:00:19.568581+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.568581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:04:25.181904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'162","reported_seq":192,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.787700+0000","last_change":"2024-01-27T13:32:18.090329+0000","last_active":"2024-01-27T13:59:30.787700+0000","last_peered":"2024-01-27T13:59:30.787700+0000","last_clean":"2024-01-27T13:59:30.787700+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T13:59:30.787700+0000","last_undegraded":"2024-01-27T13:59:30.787700+0000","last_fullsized":"2024-01-27T13:59:30.787700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":10103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'33","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067585+0000","last_change":"2024-01-27T13:32:51.715993+0000","last_active":"2024-01-27T14:00:05.067585+0000","last_peered":"2024-01-27T14:00:05.067585+0000","last_clean":"2024-01-27T14:00:05.067585+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T14:00:05.067585+0000","last_undegraded":"2024-01-27T14:00:05.067585+0000","last_fullsized":"2024-01-27T14:00:05.067585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.539160+0000","last_change":"2024-01-27T14:00:17.539181+0000","last_active":"2024-01-27T14:00:17.539160+0000","last_peered":"2024-01-27T14:00:17.539160+0000","last_clean":"2024-01-27T14:00:17.539160+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T14:00:17.539160+0000","last_undegraded":"2024-01-27T14:00:17.539160+0000","last_fullsized":"2024-01-27T14:00:17.539160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-01-27T14:00:17.539092+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-01-27T14:00:17.539092+0000","last_clean_scrub_stamp":"2024-01-27T14:00:17.539092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:43:12.193574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'135","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.046135+0000","last_change":"2024-01-27T13:32:18.349768+0000","last_active":"2024-01-27T13:59:33.046135+0000","last_peered":"2024-01-27T13:59:33.046135+0000","last_clean":"2024-01-27T13:59:33.046135+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T13:59:33.046135+0000","last_undegraded":"2024-01-27T13:59:33.046135+0000","last_fullsized":"2024-01-27T13:59:33.046135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.532444+0000","last_change":"2024-01-27T13:32:13.636789+0000","last_active":"2024-01-27T13:59:32.532444+0000","last_peered":"2024-01-27T13:59:32.532444+0000","last_clean":"2024-01-27T13:59:32.532444+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T13:59:32.532444+0000","last_undegraded":"2024-01-27T13:59:32.532444+0000","last_fullsized":"2024-01-27T13:59:32.532444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:47.294641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.617100+0000","last_change":"2024-01-27T13:32:12.379448+0000","last_active":"2024-01-27T13:59:53.617100+0000","last_peered":"2024-01-27T13:59:53.617100+0000","last_clean":"2024-01-27T13:59:53.617100+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T13:59:53.617100+0000","last_undegraded":"2024-01-27T13:59:53.617100+0000","last_fullsized":"2024-01-27T13:59:53.617100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'105","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.217803+0000","last_change":"2024-01-27T13:32:18.087732+0000","last_active":"2024-01-27T13:59:33.217803+0000","last_peered":"2024-01-27T13:59:33.217803+0000","last_clean":"2024-01-27T13:59:33.217803+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T13:59:33.217803+0000","last_undegraded":"2024-01-27T13:59:33.217803+0000","last_fullsized":"2024-01-27T13:59:33.217803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":9310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183763+0000","last_change":"2024-01-27T13:32:13.531371+0000","last_active":"2024-01-27T14:00:05.183763+0000","last_peered":"2024-01-27T14:00:05.183763+0000","last_clean":"2024-01-27T14:00:05.183763+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T14:00:05.183763+0000","last_undegraded":"2024-01-27T14:00:05.183763+0000","last_fullsized":"2024-01-27T14:00:05.183763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632858+0000","last_change":"2024-01-27T13:32:12.382388+0000","last_active":"2024-01-27T13:59:55.632858+0000","last_peered":"2024-01-27T13:59:55.632858+0000","last_clean":"2024-01-27T13:59:55.632858+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T13:59:55.632858+0000","last_undegraded":"2024-01-27T13:59:55.632858+0000","last_fullsized":"2024-01-27T13:59:55.632858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:51.973771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'127","reported_seq":158,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.215260+0000","last_change":"2024-01-27T13:32:18.350162+0000","last_active":"2024-01-27T13:59:33.215260+0000","last_peered":"2024-01-27T13:59:33.215260+0000","last_clean":"2024-01-27T13:59:33.215260+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T13:59:33.215260+0000","last_undegraded":"2024-01-27T13:59:33.215260+0000","last_fullsized":"2024-01-27T13:59:33.215260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:17.145969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":6403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015480+0000","last_change":"2024-01-27T13:32:13.635403+0000","last_active":"2024-01-27T14:00:05.015480+0000","last_peered":"2024-01-27T14:00:05.015480+0000","last_clean":"2024-01-27T14:00:05.015480+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T14:00:05.015480+0000","last_undegraded":"2024-01-27T14:00:05.015480+0000","last_fullsized":"2024-01-27T14:00:05.015480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'309","reported_seq":348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:03.617953+0000","last_change":"2024-01-27T13:32:12.379608+0000","last_active":"2024-01-27T14:00:03.617953+0000","last_peered":"2024-01-27T14:00:03.617953+0000","last_clean":"2024-01-27T14:00:03.617953+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T14:00:03.617953+0000","last_undegraded":"2024-01-27T14:00:03.617953+0000","last_fullsized":"2024-01-27T14:00:03.617953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'143","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.107288+0000","last_change":"2024-01-27T13:32:51.674638+0000","last_active":"2024-01-27T13:59:35.107288+0000","last_peered":"2024-01-27T13:59:35.107288+0000","last_clean":"2024-01-27T13:59:35.107288+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T13:59:35.107288+0000","last_undegraded":"2024-01-27T13:59:35.107288+0000","last_fullsized":"2024-01-27T13:59:35.107288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'31","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.999930+0000","last_change":"2024-01-27T13:32:13.531893+0000","last_active":"2024-01-27T14:00:04.999930+0000","last_peered":"2024-01-27T14:00:04.999930+0000","last_clean":"2024-01-27T14:00:04.999930+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T14:00:04.999930+0000","last_undegraded":"2024-01-27T14:00:04.999930+0000","last_fullsized":"2024-01-27T14:00:04.999930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:43.240701+0000","last_change":"2024-01-27T13:32:12.379023+0000","last_active":"2024-01-27T13:59:43.240701+0000","last_peered":"2024-01-27T13:59:43.240701+0000","last_clean":"2024-01-27T13:59:43.240701+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T13:59:43.240701+0000","last_undegraded":"2024-01-27T13:59:43.240701+0000","last_fullsized":"2024-01-27T13:59:43.240701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:01.557917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'116","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.416528+0000","last_change":"2024-01-27T13:32:18.347594+0000","last_active":"2024-01-27T13:59:36.416528+0000","last_peered":"2024-01-27T13:59:36.416528+0000","last_clean":"2024-01-27T13:59:36.416528+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T13:59:36.416528+0000","last_undegraded":"2024-01-27T13:59:36.416528+0000","last_fullsized":"2024-01-27T13:59:36.416528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'33","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017991+0000","last_change":"2024-01-27T13:32:13.636386+0000","last_active":"2024-01-27T14:00:05.017991+0000","last_peered":"2024-01-27T14:00:05.017991+0000","last_clean":"2024-01-27T14:00:05.017991+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T14:00:05.017991+0000","last_undegraded":"2024-01-27T14:00:05.017991+0000","last_fullsized":"2024-01-27T14:00:05.017991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:44:28.033622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.608168+0000","last_change":"2024-01-27T13:32:12.379091+0000","last_active":"2024-01-27T13:59:53.608168+0000","last_peered":"2024-01-27T13:59:53.608168+0000","last_clean":"2024-01-27T13:59:53.608168+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T13:59:53.608168+0000","last_undegraded":"2024-01-27T13:59:53.608168+0000","last_fullsized":"2024-01-27T13:59:53.608168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'170","reported_seq":202,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.444520+0000","last_change":"2024-01-27T13:32:18.089631+0000","last_active":"2024-01-27T13:59:36.444520+0000","last_peered":"2024-01-27T13:59:36.444520+0000","last_clean":"2024-01-27T13:59:36.444520+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T13:59:36.444520+0000","last_undegraded":"2024-01-27T13:59:36.444520+0000","last_fullsized":"2024-01-27T13:59:36.444520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.010376+0000","last_change":"2024-01-27T13:32:13.638616+0000","last_active":"2024-01-27T14:00:05.010376+0000","last_peered":"2024-01-27T14:00:05.010376+0000","last_clean":"2024-01-27T14:00:05.010376+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T14:00:05.010376+0000","last_undegraded":"2024-01-27T14:00:05.010376+0000","last_fullsized":"2024-01-27T14:00:05.010376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:08.044610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.205445+0000","last_change":"2024-01-27T13:32:12.373101+0000","last_active":"2024-01-27T13:59:42.205445+0000","last_peered":"2024-01-27T13:59:42.205445+0000","last_clean":"2024-01-27T13:59:42.205445+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T13:59:42.205445+0000","last_undegraded":"2024-01-27T13:59:42.205445+0000","last_fullsized":"2024-01-27T13:59:42.205445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:57:03.567104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'103","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.444336+0000","last_change":"2024-01-27T13:32:18.078448+0000","last_active":"2024-01-27T13:59:36.444336+0000","last_peered":"2024-01-27T13:59:36.444336+0000","last_clean":"2024-01-27T13:59:36.444336+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T13:59:36.444336+0000","last_undegraded":"2024-01-27T13:59:36.444336+0000","last_fullsized":"2024-01-27T13:59:36.444336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:16.277958+0000","last_change":"2024-01-27T13:32:13.531949+0000","last_active":"2024-01-27T14:00:16.277958+0000","last_peered":"2024-01-27T14:00:16.277958+0000","last_clean":"2024-01-27T14:00:16.277958+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T14:00:16.277958+0000","last_undegraded":"2024-01-27T14:00:16.277958+0000","last_fullsized":"2024-01-27T14:00:16.277958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'896","reported_seq":1835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.283916+0000","last_change":"2024-01-27T14:00:17.283941+0000","last_active":"2024-01-27T14:00:17.283916+0000","last_peered":"2024-01-27T14:00:17.283916+0000","last_clean":"2024-01-27T14:00:17.283916+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T14:00:17.283916+0000","last_undegraded":"2024-01-27T14:00:17.283916+0000","last_fullsized":"2024-01-27T14:00:17.283916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'896","last_scrub_stamp":"2024-01-27T14:00:17.283831+0000","last_deep_scrub":"27'896","last_deep_scrub_stamp":"2024-01-27T14:00:17.283831+0000","last_clean_scrub_stamp":"2024-01-27T14:00:17.283831+0000","objects_scrubbed":1,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:15:50.567015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198130,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":891,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'141","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.444906+0000","last_change":"2024-01-27T13:32:18.076446+0000","last_active":"2024-01-27T13:59:36.444906+0000","last_peered":"2024-01-27T13:59:36.444906+0000","last_clean":"2024-01-27T13:59:36.444906+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T13:59:36.444906+0000","last_undegraded":"2024-01-27T13:59:36.444906+0000","last_fullsized":"2024-01-27T13:59:36.444906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":10872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183771+0000","last_change":"2024-01-27T13:32:13.639479+0000","last_active":"2024-01-27T14:00:05.183771+0000","last_peered":"2024-01-27T14:00:05.183771+0000","last_clean":"2024-01-27T14:00:05.183771+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T14:00:05.183771+0000","last_undegraded":"2024-01-27T14:00:05.183771+0000","last_fullsized":"2024-01-27T14:00:05.183771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'433","reported_seq":473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.282750+0000","last_change":"2024-01-27T13:32:12.381062+0000","last_active":"2024-01-27T14:00:05.282750+0000","last_peered":"2024-01-27T14:00:05.282750+0000","last_clean":"2024-01-27T14:00:05.282750+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T14:00:05.282750+0000","last_undegraded":"2024-01-27T14:00:05.282750+0000","last_fullsized":"2024-01-27T14:00:05.282750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087528,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'130","reported_seq":161,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.096202+0000","last_change":"2024-01-27T13:32:18.347000+0000","last_active":"2024-01-27T13:59:35.096202+0000","last_peered":"2024-01-27T13:59:35.096202+0000","last_clean":"2024-01-27T13:59:35.096202+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T13:59:35.096202+0000","last_undegraded":"2024-01-27T13:59:35.096202+0000","last_fullsized":"2024-01-27T13:59:35.096202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":9704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013527+0000","last_change":"2024-01-27T13:32:13.637106+0000","last_active":"2024-01-27T14:00:05.013527+0000","last_peered":"2024-01-27T14:00:05.013527+0000","last_clean":"2024-01-27T14:00:05.013527+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T14:00:05.013527+0000","last_undegraded":"2024-01-27T14:00:05.013527+0000","last_fullsized":"2024-01-27T14:00:05.013527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.520681+0000","last_change":"2024-01-27T13:32:12.378753+0000","last_active":"2024-01-27T13:59:49.520681+0000","last_peered":"2024-01-27T13:59:49.520681+0000","last_clean":"2024-01-27T13:59:49.520681+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T13:59:49.520681+0000","last_undegraded":"2024-01-27T13:59:49.520681+0000","last_fullsized":"2024-01-27T13:59:49.520681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:44:06.724178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:08.571285+0000","last_change":"2024-01-27T13:31:59.954134+0000","last_active":"2024-01-27T13:58:08.571285+0000","last_peered":"2024-01-27T13:58:08.571285+0000","last_clean":"2024-01-27T13:58:08.571285+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T13:58:08.571285+0000","last_undegraded":"2024-01-27T13:58:08.571285+0000","last_fullsized":"2024-01-27T13:58:08.571285+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:31:58.380129+0000","last_clean_scrub_stamp":"2024-01-27T13:31:58.380129+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:59:34.623449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'154","reported_seq":185,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.219333+0000","last_change":"2024-01-27T13:32:18.346984+0000","last_active":"2024-01-27T13:59:33.219333+0000","last_peered":"2024-01-27T13:59:33.219333+0000","last_clean":"2024-01-27T13:59:33.219333+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T13:59:33.219333+0000","last_undegraded":"2024-01-27T13:59:33.219333+0000","last_fullsized":"2024-01-27T13:59:33.219333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:21.245217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'32","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.098651+0000","last_change":"2024-01-27T13:32:51.718659+0000","last_active":"2024-01-27T14:00:05.098651+0000","last_peered":"2024-01-27T14:00:05.098651+0000","last_clean":"2024-01-27T14:00:05.098651+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T14:00:05.098651+0000","last_undegraded":"2024-01-27T14:00:05.098651+0000","last_fullsized":"2024-01-27T14:00:05.098651+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:10:31.041312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:40.104893+0000","last_change":"2024-01-27T13:32:12.384902+0000","last_active":"2024-01-27T13:59:40.104893+0000","last_peered":"2024-01-27T13:59:40.104893+0000","last_clean":"2024-01-27T13:59:40.104893+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T13:59:40.104893+0000","last_undegraded":"2024-01-27T13:59:40.104893+0000","last_fullsized":"2024-01-27T13:59:40.104893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'132","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:23.537428+0000","last_change":"2024-01-27T13:32:18.347059+0000","last_active":"2024-01-27T13:59:23.537428+0000","last_peered":"2024-01-27T13:59:23.537428+0000","last_clean":"2024-01-27T13:59:23.537428+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T13:59:23.537428+0000","last_undegraded":"2024-01-27T13:59:23.537428+0000","last_fullsized":"2024-01-27T13:59:23.537428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:31.240478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":6638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'36","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.067804+0000","last_change":"2024-01-27T13:32:51.673578+0000","last_active":"2024-01-27T14:00:05.067804+0000","last_peered":"2024-01-27T14:00:05.067804+0000","last_clean":"2024-01-27T14:00:05.067804+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T14:00:05.067804+0000","last_undegraded":"2024-01-27T14:00:05.067804+0000","last_fullsized":"2024-01-27T14:00:05.067804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:56.634293+0000","last_change":"2024-01-27T13:32:12.382284+0000","last_active":"2024-01-27T13:59:56.634293+0000","last_peered":"2024-01-27T13:59:56.634293+0000","last_clean":"2024-01-27T13:59:56.634293+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T13:59:56.634293+0000","last_undegraded":"2024-01-27T13:59:56.634293+0000","last_fullsized":"2024-01-27T13:59:56.634293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'178","reported_seq":209,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.100444+0000","last_change":"2024-01-27T13:32:18.090722+0000","last_active":"2024-01-27T13:59:35.100444+0000","last_peered":"2024-01-27T13:59:35.100444+0000","last_clean":"2024-01-27T13:59:35.100444+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T13:59:35.100444+0000","last_undegraded":"2024-01-27T13:59:35.100444+0000","last_fullsized":"2024-01-27T13:59:35.100444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":15130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'33","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085883+0000","last_change":"2024-01-27T13:32:13.639014+0000","last_active":"2024-01-27T14:00:05.085883+0000","last_peered":"2024-01-27T14:00:05.085883+0000","last_clean":"2024-01-27T14:00:05.085883+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T14:00:05.085883+0000","last_undegraded":"2024-01-27T14:00:05.085883+0000","last_fullsized":"2024-01-27T14:00:05.085883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:48:51.336115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.246602+0000","last_change":"2024-01-27T14:00:18.246627+0000","last_active":"2024-01-27T14:00:18.246602+0000","last_peered":"2024-01-27T14:00:18.246602+0000","last_clean":"2024-01-27T14:00:18.246602+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T14:00:18.246602+0000","last_undegraded":"2024-01-27T14:00:18.246602+0000","last_fullsized":"2024-01-27T14:00:18.246602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-01-27T14:00:18.246537+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-01-27T14:00:18.246537+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.246537+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:56:05.432420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'133","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:33.996698+0000","last_change":"2024-01-27T13:32:18.347312+0000","last_active":"2024-01-27T13:59:33.996698+0000","last_peered":"2024-01-27T13:59:33.996698+0000","last_clean":"2024-01-27T13:59:33.996698+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T13:59:33.996698+0000","last_undegraded":"2024-01-27T13:59:33.996698+0000","last_fullsized":"2024-01-27T13:59:33.996698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:37:17.637797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085515+0000","last_change":"2024-01-27T13:32:13.638471+0000","last_active":"2024-01-27T14:00:05.085515+0000","last_peered":"2024-01-27T14:00:05.085515+0000","last_clean":"2024-01-27T14:00:05.085515+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T14:00:05.085515+0000","last_undegraded":"2024-01-27T14:00:05.085515+0000","last_fullsized":"2024-01-27T14:00:05.085515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:18:26.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:18.507104+0000","last_change":"2024-01-27T13:32:12.380995+0000","last_active":"2024-01-27T13:59:18.507104+0000","last_peered":"2024-01-27T13:59:18.507104+0000","last_clean":"2024-01-27T13:59:18.507104+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T13:59:18.507104+0000","last_undegraded":"2024-01-27T13:59:18.507104+0000","last_fullsized":"2024-01-27T13:59:18.507104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:21:51.380474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'153","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:32.502177+0000","last_change":"2024-01-27T13:32:18.089897+0000","last_active":"2024-01-27T13:59:32.502177+0000","last_peered":"2024-01-27T13:59:32.502177+0000","last_clean":"2024-01-27T13:59:32.502177+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T13:59:32.502177+0000","last_undegraded":"2024-01-27T13:59:32.502177+0000","last_fullsized":"2024-01-27T13:59:32.502177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:26.155204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":10566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'31","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.099385+0000","last_change":"2024-01-27T13:32:13.642345+0000","last_active":"2024-01-27T14:00:05.099385+0000","last_peered":"2024-01-27T14:00:05.099385+0000","last_clean":"2024-01-27T14:00:05.099385+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T14:00:05.099385+0000","last_undegraded":"2024-01-27T14:00:05.099385+0000","last_fullsized":"2024-01-27T14:00:05.099385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'19","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.273439+0000","last_change":"2024-01-27T14:00:19.273465+0000","last_active":"2024-01-27T14:00:19.273439+0000","last_peered":"2024-01-27T14:00:19.273439+0000","last_clean":"2024-01-27T14:00:19.273439+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T14:00:19.273439+0000","last_undegraded":"2024-01-27T14:00:19.273439+0000","last_fullsized":"2024-01-27T14:00:19.273439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-01-27T14:00:19.273370+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-01-27T14:00:19.273370+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.273370+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:45:07.025269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'137","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.416617+0000","last_change":"2024-01-27T13:32:18.075714+0000","last_active":"2024-01-27T13:59:36.416617+0000","last_peered":"2024-01-27T13:59:36.416617+0000","last_clean":"2024-01-27T13:59:36.416617+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T13:59:36.416617+0000","last_undegraded":"2024-01-27T13:59:36.416617+0000","last_fullsized":"2024-01-27T13:59:36.416617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":8266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'29","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.074602+0000","last_change":"2024-01-27T13:32:13.634306+0000","last_active":"2024-01-27T14:00:05.074602+0000","last_peered":"2024-01-27T14:00:05.074602+0000","last_clean":"2024-01-27T14:00:05.074602+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T14:00:05.074602+0000","last_undegraded":"2024-01-27T14:00:05.074602+0000","last_fullsized":"2024-01-27T14:00:05.074602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:40:03.112733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.749144+0000","last_change":"2024-01-27T13:32:12.384486+0000","last_active":"2024-01-27T13:59:58.749144+0000","last_peered":"2024-01-27T13:59:58.749144+0000","last_clean":"2024-01-27T13:59:58.749144+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T13:59:58.749144+0000","last_undegraded":"2024-01-27T13:59:58.749144+0000","last_fullsized":"2024-01-27T13:59:58.749144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:05:54.630941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.452435+0000","last_change":"2024-01-27T13:32:18.351099+0000","last_active":"2024-01-27T13:59:36.452435+0000","last_peered":"2024-01-27T13:59:36.452435+0000","last_clean":"2024-01-27T13:59:36.452435+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T13:59:36.452435+0000","last_undegraded":"2024-01-27T13:59:36.452435+0000","last_fullsized":"2024-01-27T13:59:36.452435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":8731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'42","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.126569+0000","last_change":"2024-01-27T13:32:13.638101+0000","last_active":"2024-01-27T14:00:05.126569+0000","last_peered":"2024-01-27T14:00:05.126569+0000","last_clean":"2024-01-27T14:00:05.126569+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T14:00:05.126569+0000","last_undegraded":"2024-01-27T14:00:05.126569+0000","last_fullsized":"2024-01-27T14:00:05.126569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:28:21.502040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.709766+0000","last_change":"2024-01-27T13:32:12.356691+0000","last_active":"2024-01-27T13:59:58.709766+0000","last_peered":"2024-01-27T13:59:58.709766+0000","last_clean":"2024-01-27T13:59:58.709766+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T13:59:58.709766+0000","last_undegraded":"2024-01-27T13:59:58.709766+0000","last_fullsized":"2024-01-27T13:59:58.709766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:11:31.138464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'100","reported_seq":130,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.108016+0000","last_change":"2024-01-27T13:32:18.351100+0000","last_active":"2024-01-27T13:59:35.108016+0000","last_peered":"2024-01-27T13:59:35.108016+0000","last_clean":"2024-01-27T13:59:35.108016+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T13:59:35.108016+0000","last_undegraded":"2024-01-27T13:59:35.108016+0000","last_fullsized":"2024-01-27T13:59:35.108016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'37","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:12.545941+0000","last_change":"2024-01-27T13:32:13.600775+0000","last_active":"2024-01-27T14:00:12.545941+0000","last_peered":"2024-01-27T14:00:12.545941+0000","last_clean":"2024-01-27T14:00:12.545941+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T14:00:12.545941+0000","last_undegraded":"2024-01-27T14:00:12.545941+0000","last_fullsized":"2024-01-27T14:00:12.545941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:12.545964+0000","last_change":"2024-01-27T13:32:12.382126+0000","last_active":"2024-01-27T14:00:12.545964+0000","last_peered":"2024-01-27T14:00:12.545964+0000","last_clean":"2024-01-27T14:00:12.545964+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T14:00:12.545964+0000","last_undegraded":"2024-01-27T14:00:12.545964+0000","last_fullsized":"2024-01-27T14:00:12.545964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'140","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:35.108071+0000","last_change":"2024-01-27T13:32:18.346679+0000","last_active":"2024-01-27T13:59:35.108071+0000","last_peered":"2024-01-27T13:59:35.108071+0000","last_clean":"2024-01-27T13:59:35.108071+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T13:59:35.108071+0000","last_undegraded":"2024-01-27T13:59:35.108071+0000","last_fullsized":"2024-01-27T13:59:35.108071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:37.928657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":9178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083080+0000","last_change":"2024-01-27T13:32:13.635218+0000","last_active":"2024-01-27T14:00:05.083080+0000","last_peered":"2024-01-27T14:00:05.083080+0000","last_clean":"2024-01-27T14:00:05.083080+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T14:00:05.083080+0000","last_undegraded":"2024-01-27T14:00:05.083080+0000","last_fullsized":"2024-01-27T14:00:05.083080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:47:12.415128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'861","reported_seq":899,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.629200+0000","last_change":"2024-01-27T13:32:12.379072+0000","last_active":"2024-01-27T13:59:58.629200+0000","last_peered":"2024-01-27T13:59:58.629200+0000","last_clean":"2024-01-27T13:59:58.629200+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T13:59:58.629200+0000","last_undegraded":"2024-01-27T13:59:58.629200+0000","last_fullsized":"2024-01-27T13:59:58.629200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:46:06.950061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":4566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'134","reported_seq":165,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:16.278096+0000","last_change":"2024-01-27T13:32:18.074566+0000","last_active":"2024-01-27T14:00:16.278096+0000","last_peered":"2024-01-27T14:00:16.278096+0000","last_clean":"2024-01-27T14:00:16.278096+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T14:00:16.278096+0000","last_undegraded":"2024-01-27T14:00:16.278096+0000","last_fullsized":"2024-01-27T14:00:16.278096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'29","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018979+0000","last_change":"2024-01-27T13:32:13.642624+0000","last_active":"2024-01-27T14:00:05.018979+0000","last_peered":"2024-01-27T14:00:05.018979+0000","last_clean":"2024-01-27T14:00:05.018979+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T14:00:05.018979+0000","last_undegraded":"2024-01-27T14:00:05.018979+0000","last_fullsized":"2024-01-27T14:00:05.018979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:31:29.250482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'605","reported_seq":651,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.587383+0000","last_change":"2024-01-27T14:00:18.587424+0000","last_active":"2024-01-27T14:00:18.587383+0000","last_peered":"2024-01-27T14:00:18.587383+0000","last_clean":"2024-01-27T14:00:18.587383+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T14:00:18.587383+0000","last_undegraded":"2024-01-27T14:00:18.587383+0000","last_fullsized":"2024-01-27T14:00:18.587383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'605","last_scrub_stamp":"2024-01-27T14:00:18.587307+0000","last_deep_scrub":"27'605","last_deep_scrub_stamp":"2024-01-27T14:00:18.587307+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.587307+0000","objects_scrubbed":2,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:01:32.639892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'142","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:36.449574+0000","last_change":"2024-01-27T13:32:18.090396+0000","last_active":"2024-01-27T13:59:36.449574+0000","last_peered":"2024-01-27T13:59:36.449574+0000","last_clean":"2024-01-27T13:59:36.449574+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T13:59:36.449574+0000","last_undegraded":"2024-01-27T13:59:36.449574+0000","last_fullsized":"2024-01-27T13:59:36.449574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:55.102369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":22998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185185+0000","last_change":"2024-01-27T13:32:13.602016+0000","last_active":"2024-01-27T14:00:05.185185+0000","last_peered":"2024-01-27T14:00:05.185185+0000","last_clean":"2024-01-27T14:00:05.185185+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T14:00:05.185185+0000","last_undegraded":"2024-01-27T14:00:05.185185+0000","last_fullsized":"2024-01-27T14:00:05.185185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:42.195625+0000","last_change":"2024-01-27T13:32:12.379525+0000","last_active":"2024-01-27T13:59:42.195625+0000","last_peered":"2024-01-27T13:59:42.195625+0000","last_clean":"2024-01-27T13:59:42.195625+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T13:59:42.195625+0000","last_undegraded":"2024-01-27T13:59:42.195625+0000","last_fullsized":"2024-01-27T13:59:42.195625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:14:14.154045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'115","reported_seq":146,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.902399+0000","last_change":"2024-01-27T13:32:18.090807+0000","last_active":"2024-01-27T14:00:17.902399+0000","last_peered":"2024-01-27T14:00:17.902399+0000","last_clean":"2024-01-27T14:00:17.902399+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T14:00:17.902399+0000","last_undegraded":"2024-01-27T14:00:17.902399+0000","last_fullsized":"2024-01-27T14:00:17.902399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'40","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.056984+0000","last_change":"2024-01-27T13:32:13.603574+0000","last_active":"2024-01-27T14:00:05.056984+0000","last_peered":"2024-01-27T14:00:05.056984+0000","last_clean":"2024-01-27T14:00:05.056984+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T14:00:05.056984+0000","last_undegraded":"2024-01-27T14:00:05.056984+0000","last_fullsized":"2024-01-27T14:00:05.056984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:05:10.536661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:55.632091+0000","last_change":"2024-01-27T13:32:12.385239+0000","last_active":"2024-01-27T13:59:55.632091+0000","last_peered":"2024-01-27T13:59:55.632091+0000","last_clean":"2024-01-27T13:59:55.632091+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T13:59:55.632091+0000","last_undegraded":"2024-01-27T13:59:55.632091+0000","last_fullsized":"2024-01-27T13:59:55.632091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:42:46.200092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'145","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.902461+0000","last_change":"2024-01-27T13:32:18.347008+0000","last_active":"2024-01-27T14:00:17.902461+0000","last_peered":"2024-01-27T14:00:17.902461+0000","last_clean":"2024-01-27T14:00:17.902461+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T14:00:17.902461+0000","last_undegraded":"2024-01-27T14:00:17.902461+0000","last_fullsized":"2024-01-27T14:00:17.902461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'135","reported_seq":168,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:15.482736+0000","last_change":"2024-01-27T13:32:18.347249+0000","last_active":"2024-01-27T14:00:15.482736+0000","last_peered":"2024-01-27T14:00:15.482736+0000","last_clean":"2024-01-27T14:00:15.482736+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T14:00:15.482736+0000","last_undegraded":"2024-01-27T14:00:15.482736+0000","last_fullsized":"2024-01-27T14:00:15.482736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":11460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.003797+0000","last_change":"2024-01-27T13:32:13.634963+0000","last_active":"2024-01-27T14:00:05.003797+0000","last_peered":"2024-01-27T14:00:05.003797+0000","last_clean":"2024-01-27T14:00:05.003797+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T14:00:05.003797+0000","last_undegraded":"2024-01-27T14:00:05.003797+0000","last_fullsized":"2024-01-27T14:00:05.003797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:58:48.616130+0000","last_change":"2024-01-27T13:32:12.378076+0000","last_active":"2024-01-27T13:58:48.616130+0000","last_peered":"2024-01-27T13:58:48.616130+0000","last_clean":"2024-01-27T13:58:48.616130+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T13:58:48.616130+0000","last_undegraded":"2024-01-27T13:58:48.616130+0000","last_fullsized":"2024-01-27T13:58:48.616130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:38.265753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'150","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:30.795209+0000","last_change":"2024-01-27T13:32:51.707209+0000","last_active":"2024-01-27T13:59:30.795209+0000","last_peered":"2024-01-27T13:59:30.795209+0000","last_clean":"2024-01-27T13:59:30.795209+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T13:59:30.795209+0000","last_undegraded":"2024-01-27T13:59:30.795209+0000","last_fullsized":"2024-01-27T13:59:30.795209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:28:40.489268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":19231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.009927+0000","last_change":"2024-01-27T13:32:13.633858+0000","last_active":"2024-01-27T14:00:05.009927+0000","last_peered":"2024-01-27T14:00:05.009927+0000","last_clean":"2024-01-27T14:00:05.009927+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T14:00:05.009927+0000","last_undegraded":"2024-01-27T14:00:05.009927+0000","last_fullsized":"2024-01-27T14:00:05.009927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:58.746487+0000","last_change":"2024-01-27T13:32:12.380154+0000","last_active":"2024-01-27T13:59:58.746487+0000","last_peered":"2024-01-27T13:59:58.746487+0000","last_clean":"2024-01-27T13:59:58.746487+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T13:59:58.746487+0000","last_undegraded":"2024-01-27T13:59:58.746487+0000","last_fullsized":"2024-01-27T13:59:58.746487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'691","reported_seq":728,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.515899+0000","last_change":"2024-01-27T13:32:12.384710+0000","last_active":"2024-01-27T13:59:49.515899+0000","last_peered":"2024-01-27T13:59:49.515899+0000","last_clean":"2024-01-27T13:59:49.515899+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T13:59:49.515899+0000","last_undegraded":"2024-01-27T13:59:49.515899+0000","last_fullsized":"2024-01-27T13:59:49.515899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:09:07.532094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.184135+0000","last_change":"2024-01-27T13:32:13.639350+0000","last_active":"2024-01-27T14:00:05.184135+0000","last_peered":"2024-01-27T14:00:05.184135+0000","last_clean":"2024-01-27T14:00:05.184135+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T14:00:05.184135+0000","last_undegraded":"2024-01-27T14:00:05.184135+0000","last_fullsized":"2024-01-27T14:00:05.184135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'81","reported_seq":111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.550223+0000","last_change":"2024-01-27T13:32:18.073906+0000","last_active":"2024-01-27T13:59:49.550223+0000","last_peered":"2024-01-27T13:59:49.550223+0000","last_clean":"2024-01-27T13:59:49.550223+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T13:59:49.550223+0000","last_undegraded":"2024-01-27T13:59:49.550223+0000","last_fullsized":"2024-01-27T13:59:49.550223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'709","reported_seq":747,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:53.608575+0000","last_change":"2024-01-27T13:32:12.372212+0000","last_active":"2024-01-27T13:59:53.608575+0000","last_peered":"2024-01-27T13:59:53.608575+0000","last_clean":"2024-01-27T13:59:53.608575+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T13:59:53.608575+0000","last_undegraded":"2024-01-27T13:59:53.608575+0000","last_fullsized":"2024-01-27T13:59:53.608575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:11.125539+0000","last_clean_scrub_stamp":"2024-01-27T13:32:11.125539+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'31","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018462+0000","last_change":"2024-01-27T13:32:13.637373+0000","last_active":"2024-01-27T14:00:05.018462+0000","last_peered":"2024-01-27T14:00:05.018462+0000","last_clean":"2024-01-27T14:00:05.018462+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T14:00:05.018462+0000","last_undegraded":"2024-01-27T14:00:05.018462+0000","last_fullsized":"2024-01-27T14:00:05.018462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:47:53.068319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'143","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T13:59:49.566531+0000","last_change":"2024-01-27T13:32:18.089988+0000","last_active":"2024-01-27T13:59:49.566531+0000","last_peered":"2024-01-27T13:59:49.566531+0000","last_clean":"2024-01-27T13:59:49.566531+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T13:59:49.566531+0000","last_undegraded":"2024-01-27T13:59:49.566531+0000","last_fullsized":"2024-01-27T13:59:49.566531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:16.873251+0000","last_clean_scrub_stamp":"2024-01-27T13:32:16.873251+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'46","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082677+0000","last_change":"2024-01-27T13:32:13.634737+0000","last_active":"2024-01-27T14:00:05.082677+0000","last_peered":"2024-01-27T14:00:05.082677+0000","last_clean":"2024-01-27T14:00:05.082677+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T14:00:05.082677+0000","last_undegraded":"2024-01-27T14:00:05.082677+0000","last_fullsized":"2024-01-27T14:00:05.082677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:22:50.294516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'45","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.075627+0000","last_change":"2024-01-27T13:32:13.600995+0000","last_active":"2024-01-27T14:00:05.075627+0000","last_peered":"2024-01-27T14:00:05.075627+0000","last_clean":"2024-01-27T14:00:05.075627+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T14:00:05.075627+0000","last_undegraded":"2024-01-27T14:00:05.075627+0000","last_fullsized":"2024-01-27T14:00:05.075627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.012785+0000","last_change":"2024-01-27T13:32:13.639535+0000","last_active":"2024-01-27T14:00:05.012785+0000","last_peered":"2024-01-27T14:00:05.012785+0000","last_clean":"2024-01-27T14:00:05.012785+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T14:00:05.012785+0000","last_undegraded":"2024-01-27T14:00:05.012785+0000","last_fullsized":"2024-01-27T14:00:05.012785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:21:37.367342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'33","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183384+0000","last_change":"2024-01-27T13:32:13.635359+0000","last_active":"2024-01-27T14:00:05.183384+0000","last_peered":"2024-01-27T14:00:05.183384+0000","last_clean":"2024-01-27T14:00:05.183384+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T14:00:05.183384+0000","last_undegraded":"2024-01-27T14:00:05.183384+0000","last_fullsized":"2024-01-27T14:00:05.183384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'24","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015977+0000","last_change":"2024-01-27T13:32:13.638118+0000","last_active":"2024-01-27T14:00:05.015977+0000","last_peered":"2024-01-27T14:00:05.015977+0000","last_clean":"2024-01-27T14:00:05.015977+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T14:00:05.015977+0000","last_undegraded":"2024-01-27T14:00:05.015977+0000","last_fullsized":"2024-01-27T14:00:05.015977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:04.998939+0000","last_change":"2024-01-27T13:32:13.635989+0000","last_active":"2024-01-27T14:00:04.998939+0000","last_peered":"2024-01-27T14:00:04.998939+0000","last_clean":"2024-01-27T14:00:04.998939+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T14:00:04.998939+0000","last_undegraded":"2024-01-27T14:00:04.998939+0000","last_fullsized":"2024-01-27T14:00:04.998939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'43","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083694+0000","last_change":"2024-01-27T13:32:13.632393+0000","last_active":"2024-01-27T14:00:05.083694+0000","last_peered":"2024-01-27T14:00:05.083694+0000","last_clean":"2024-01-27T14:00:05.083694+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T14:00:05.083694+0000","last_undegraded":"2024-01-27T14:00:05.083694+0000","last_fullsized":"2024-01-27T14:00:05.083694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T13:54:59.086784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.269252+0000","last_change":"2024-01-27T14:00:19.269274+0000","last_active":"2024-01-27T14:00:19.269252+0000","last_peered":"2024-01-27T14:00:19.269252+0000","last_clean":"2024-01-27T14:00:19.269252+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T14:00:19.269252+0000","last_undegraded":"2024-01-27T14:00:19.269252+0000","last_fullsized":"2024-01-27T14:00:19.269252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-01-27T14:00:19.269181+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-01-27T14:00:19.269181+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.269181+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:36:11.407012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015254+0000","last_change":"2024-01-27T13:32:13.636261+0000","last_active":"2024-01-27T14:00:05.015254+0000","last_peered":"2024-01-27T14:00:05.015254+0000","last_clean":"2024-01-27T14:00:05.015254+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T14:00:05.015254+0000","last_undegraded":"2024-01-27T14:00:05.015254+0000","last_fullsized":"2024-01-27T14:00:05.015254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:11:16.116746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.297778+0000","last_change":"2024-01-27T14:00:18.297798+0000","last_active":"2024-01-27T14:00:18.297778+0000","last_peered":"2024-01-27T14:00:18.297778+0000","last_clean":"2024-01-27T14:00:18.297778+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T14:00:18.297778+0000","last_undegraded":"2024-01-27T14:00:18.297778+0000","last_fullsized":"2024-01-27T14:00:18.297778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-01-27T14:00:18.297720+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-01-27T14:00:18.297720+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.297720+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:04:23.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.051296+0000","last_change":"2024-01-27T13:32:13.602614+0000","last_active":"2024-01-27T14:00:05.051296+0000","last_peered":"2024-01-27T14:00:05.051296+0000","last_clean":"2024-01-27T14:00:05.051296+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T14:00:05.051296+0000","last_undegraded":"2024-01-27T14:00:05.051296+0000","last_fullsized":"2024-01-27T14:00:05.051296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:07.495043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'45","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.183883+0000","last_change":"2024-01-27T13:32:13.600778+0000","last_active":"2024-01-27T14:00:05.183883+0000","last_peered":"2024-01-27T14:00:05.183883+0000","last_clean":"2024-01-27T14:00:05.183883+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T14:00:05.183883+0000","last_undegraded":"2024-01-27T14:00:05.183883+0000","last_fullsized":"2024-01-27T14:00:05.183883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'40","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082845+0000","last_change":"2024-01-27T13:32:13.638134+0000","last_active":"2024-01-27T14:00:05.082845+0000","last_peered":"2024-01-27T14:00:05.082845+0000","last_clean":"2024-01-27T14:00:05.082845+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T14:00:05.082845+0000","last_undegraded":"2024-01-27T14:00:05.082845+0000","last_fullsized":"2024-01-27T14:00:05.082845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:03:10.212483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080535+0000","last_change":"2024-01-27T13:32:13.601821+0000","last_active":"2024-01-27T14:00:05.080535+0000","last_peered":"2024-01-27T14:00:05.080535+0000","last_clean":"2024-01-27T14:00:05.080535+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T14:00:05.080535+0000","last_undegraded":"2024-01-27T14:00:05.080535+0000","last_fullsized":"2024-01-27T14:00:05.080535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:38:16.592054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:14.552189+0000","last_change":"2024-01-27T13:32:13.633365+0000","last_active":"2024-01-27T14:00:14.552189+0000","last_peered":"2024-01-27T14:00:14.552189+0000","last_clean":"2024-01-27T14:00:14.552189+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T14:00:14.552189+0000","last_undegraded":"2024-01-27T14:00:14.552189+0000","last_fullsized":"2024-01-27T14:00:14.552189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'38","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.018857+0000","last_change":"2024-01-27T13:32:13.603421+0000","last_active":"2024-01-27T14:00:05.018857+0000","last_peered":"2024-01-27T14:00:05.018857+0000","last_clean":"2024-01-27T14:00:05.018857+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T14:00:05.018857+0000","last_undegraded":"2024-01-27T14:00:05.018857+0000","last_fullsized":"2024-01-27T14:00:05.018857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:49:33.433843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'36","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059851+0000","last_change":"2024-01-27T13:32:13.600368+0000","last_active":"2024-01-27T14:00:05.059851+0000","last_peered":"2024-01-27T14:00:05.059851+0000","last_clean":"2024-01-27T14:00:05.059851+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T14:00:05.059851+0000","last_undegraded":"2024-01-27T14:00:05.059851+0000","last_fullsized":"2024-01-27T14:00:05.059851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:30:06.151595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'40","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:14.596161+0000","last_change":"2024-01-27T13:32:13.639367+0000","last_active":"2024-01-27T14:00:14.596161+0000","last_peered":"2024-01-27T14:00:14.596161+0000","last_clean":"2024-01-27T14:00:14.596161+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T14:00:14.596161+0000","last_undegraded":"2024-01-27T14:00:14.596161+0000","last_fullsized":"2024-01-27T14:00:14.596161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'34","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:12.545916+0000","last_change":"2024-01-27T13:32:13.530808+0000","last_active":"2024-01-27T14:00:12.545916+0000","last_peered":"2024-01-27T14:00:12.545916+0000","last_clean":"2024-01-27T14:00:12.545916+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T14:00:12.545916+0000","last_undegraded":"2024-01-27T14:00:12.545916+0000","last_fullsized":"2024-01-27T14:00:12.545916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'37","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.013271+0000","last_change":"2024-01-27T13:32:13.638966+0000","last_active":"2024-01-27T14:00:05.013271+0000","last_peered":"2024-01-27T14:00:05.013271+0000","last_clean":"2024-01-27T14:00:05.013271+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T14:00:05.013271+0000","last_undegraded":"2024-01-27T14:00:05.013271+0000","last_fullsized":"2024-01-27T14:00:05.013271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'27","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015756+0000","last_change":"2024-01-27T13:32:13.640502+0000","last_active":"2024-01-27T14:00:05.015756+0000","last_peered":"2024-01-27T14:00:05.015756+0000","last_clean":"2024-01-27T14:00:05.015756+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T14:00:05.015756+0000","last_undegraded":"2024-01-27T14:00:05.015756+0000","last_fullsized":"2024-01-27T14:00:05.015756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:42:02.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.080044+0000","last_change":"2024-01-27T13:32:13.632861+0000","last_active":"2024-01-27T14:00:05.080044+0000","last_peered":"2024-01-27T14:00:05.080044+0000","last_clean":"2024-01-27T14:00:05.080044+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T14:00:05.080044+0000","last_undegraded":"2024-01-27T14:00:05.080044+0000","last_fullsized":"2024-01-27T14:00:05.080044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:02:33.891613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'44","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.085310+0000","last_change":"2024-01-27T13:32:13.636436+0000","last_active":"2024-01-27T14:00:05.085310+0000","last_peered":"2024-01-27T14:00:05.085310+0000","last_clean":"2024-01-27T14:00:05.085310+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T14:00:05.085310+0000","last_undegraded":"2024-01-27T14:00:05.085310+0000","last_fullsized":"2024-01-27T14:00:05.085310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:00:36.249485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'40","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.072288+0000","last_change":"2024-01-27T13:32:51.706601+0000","last_active":"2024-01-27T14:00:05.072288+0000","last_peered":"2024-01-27T14:00:05.072288+0000","last_clean":"2024-01-27T14:00:05.072288+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T14:00:05.072288+0000","last_undegraded":"2024-01-27T14:00:05.072288+0000","last_fullsized":"2024-01-27T14:00:05.072288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'30","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.015446+0000","last_change":"2024-01-27T13:32:13.637022+0000","last_active":"2024-01-27T14:00:05.015446+0000","last_peered":"2024-01-27T14:00:05.015446+0000","last_clean":"2024-01-27T14:00:05.015446+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T14:00:05.015446+0000","last_undegraded":"2024-01-27T14:00:05.015446+0000","last_fullsized":"2024-01-27T14:00:05.015446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'33","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.076729+0000","last_change":"2024-01-27T13:32:13.601179+0000","last_active":"2024-01-27T14:00:05.076729+0000","last_peered":"2024-01-27T14:00:05.076729+0000","last_clean":"2024-01-27T14:00:05.076729+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T14:00:05.076729+0000","last_undegraded":"2024-01-27T14:00:05.076729+0000","last_fullsized":"2024-01-27T14:00:05.076729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:39:22.156650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.017942+0000","last_change":"2024-01-27T13:32:13.601786+0000","last_active":"2024-01-27T14:00:05.017942+0000","last_peered":"2024-01-27T14:00:05.017942+0000","last_clean":"2024-01-27T14:00:05.017942+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T14:00:05.017942+0000","last_undegraded":"2024-01-27T14:00:05.017942+0000","last_fullsized":"2024-01-27T14:00:05.017942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:45:46.318896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.082979+0000","last_change":"2024-01-27T13:32:13.602663+0000","last_active":"2024-01-27T14:00:05.082979+0000","last_peered":"2024-01-27T14:00:05.082979+0000","last_clean":"2024-01-27T14:00:05.082979+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T14:00:05.082979+0000","last_undegraded":"2024-01-27T14:00:05.082979+0000","last_fullsized":"2024-01-27T14:00:05.082979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:28:12.492805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'25","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.059979+0000","last_change":"2024-01-27T13:32:13.638023+0000","last_active":"2024-01-27T14:00:05.059979+0000","last_peered":"2024-01-27T14:00:05.059979+0000","last_clean":"2024-01-27T14:00:05.059979+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T14:00:05.059979+0000","last_undegraded":"2024-01-27T14:00:05.059979+0000","last_fullsized":"2024-01-27T14:00:05.059979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:15:34.629418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'39","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.185258+0000","last_change":"2024-01-27T13:32:13.520280+0000","last_active":"2024-01-27T14:00:05.185258+0000","last_peered":"2024-01-27T14:00:05.185258+0000","last_clean":"2024-01-27T14:00:05.185258+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T14:00:05.185258+0000","last_undegraded":"2024-01-27T14:00:05.185258+0000","last_fullsized":"2024-01-27T14:00:05.185258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'32","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:16.492666+0000","last_change":"2024-01-27T14:00:16.492686+0000","last_active":"2024-01-27T14:00:16.492666+0000","last_peered":"2024-01-27T14:00:16.492666+0000","last_clean":"2024-01-27T14:00:16.492666+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T14:00:16.492666+0000","last_undegraded":"2024-01-27T14:00:16.492666+0000","last_fullsized":"2024-01-27T14:00:16.492666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-01-27T14:00:16.492602+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-01-27T14:00:16.492602+0000","last_clean_scrub_stamp":"2024-01-27T14:00:16.492602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:18:20.482701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:05.083482+0000","last_change":"2024-01-27T13:32:13.631190+0000","last_active":"2024-01-27T14:00:05.083482+0000","last_peered":"2024-01-27T14:00:05.083482+0000","last_clean":"2024-01-27T14:00:05.083482+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T14:00:05.083482+0000","last_undegraded":"2024-01-27T14:00:05.083482+0000","last_fullsized":"2024-01-27T14:00:05.083482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-27T13:32:12.220088+0000","last_clean_scrub_stamp":"2024-01-27T13:32:12.220088+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:58:50.449205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3814,"num_write_kb":297749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4253,"ondisk_log_size":4253,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2213,"ondisk_log_size":2213,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37841560,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":8392,"num_write_kb":41932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":75683120,"data_compressed":6983726,"data_compressed_allocated":10756096,"data_compressed_original":34791424,"omap_allocated":0,"internal_metadata":0},"log_size":7955,"ondisk_log_size":7955,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58756,"kb_used_data":9532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313084,"statfs":{"total":96636764160,"available":96576598016,"internally_reserved":0,"allocated":9760768,"data_stored":12897988,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.19600000000000001},"max":{"1min":0.439,"5min":0.48499999999999999,"15min":0.62},"last":0.313}]},{"osd":1,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.37},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.29499999999999998}]},{"osd":2,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56799999999999995,"15min":0.622},"last":0.33400000000000002}]},{"osd":4,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.497},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.47199999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.65300000000000002,"5min":0.82399999999999995,"15min":0.879},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53400000000000003}]},{"osd":7,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.433},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.44800000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":483328,"data_stored":314404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29799999999999999,"15min":0.30599999999999999},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.42799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.442,"5min":0.497,"15min":0.61699999999999999},"last":0.26200000000000001}]},{"osd":1,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22500000000000001},"max":{"1min":0.45300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.378},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46899999999999997,"5min":0.60399999999999998,"15min":0.63},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.223,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.59699999999999998},"last":0.315},{"interface":"front","average":{"1min":0.376,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.224},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.79500000000000004},"last":0.439}]},{"osd":4,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29699999999999999},"max":{"1min":0.57799999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.52700000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.79100000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47699999999999998}]},{"osd":6,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.874},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.83199999999999996,"15min":0.88100000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.373,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":0.84899999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.64100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509784,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42148,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329692,"statfs":{"total":96636764160,"available":96593604608,"internally_reserved":0,"allocated":2715648,"data_stored":4203962,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.317,"15min":0.314},"min":{"1min":0.191,"5min":0.191,"15min":0.19},"max":{"1min":0.46500000000000002,"5min":0.47899999999999998,"15min":0.51400000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.42499999999999999,"5min":0.54400000000000004,"15min":0.63200000000000001},"last":0.309}]},{"osd":2,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.317,"15min":0.318},"min":{"1min":0.221,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.72899999999999998},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.41999999999999998,"5min":0.51700000000000002,"15min":0.622},"last":0.32900000000000001}]},{"osd":3,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.63500000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":1.0149999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.86899999999999999},"last":0.39700000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41999999999999998}]},{"osd":6,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34599999999999997},"max":{"1min":0.66300000000000003,"5min":0.84299999999999997,"15min":0.871},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":1,"15min":1},"last":0.52100000000000002}]},{"osd":7,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46800000000000003}]}]},{"osd":7,"up_from":14,"seq":60129542488,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78296,"kb_used_data":16592,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94293544,"statfs":{"total":96636764160,"available":96556589056,"internally_reserved":0,"allocated":16990208,"data_stored":25766272,"data_compressed":2458257,"data_compressed_allocated":3723264,"data_compressed_original":12673024,"omap_allocated":1590,"internal_metadata":63175114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.69999999999999996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.309},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72999999999999998},"last":0.315}]},{"osd":1,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.71599999999999997},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.68500000000000005},"last":0.35599999999999998}]},{"osd":2,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.70199999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.19900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81299999999999994},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29399999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.23300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.85099999999999998},"last":0.44700000000000001}]},{"osd":6,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.26000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.82699999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.28799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439}]}]},{"osd":6,"up_from":14,"seq":60129542488,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73384,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94298456,"statfs":{"total":96636764160,"available":96561618944,"internally_reserved":0,"allocated":11960320,"data_stored":16894162,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.438,"15min":0.433},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.84099999999999997},"last":0.377},{"interface":"front","average":{"1min":0.439,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.52400000000000002}]},{"osd":1,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.873},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.68200000000000005},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":0.66900000000000004,"15min":0.80200000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.89300000000000002},"last":0.47099999999999997}]},{"osd":3,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.59999999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.436}]},{"osd":4,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.91400000000000003},"last":0.31},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.83899999999999997},"last":0.40000000000000002}]},{"osd":5,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.61899999999999999,"5min":0.68700000000000006,"15min":0.83599999999999997},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.93500000000000005},"last":0.505}]},{"osd":7,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.25900000000000001},"max":{"1min":0.65200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.81899999999999995,"15min":0.89500000000000002},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542487,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46000000000000002,"15min":0.434},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.20100000000000001},"max":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67300000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23799999999999999},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57499999999999996,"5min":0.66300000000000003,"15min":0.76300000000000001},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.44400000000000001},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":1.101,"15min":1.101},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70799999999999996},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.70099999999999996,"15min":0.71599999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.379},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.76300000000000001},"last":0.495}]},{"osd":6,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68999999999999995,"5min":0.754,"15min":0.76300000000000001},"last":0.46800000000000003}]},{"osd":7,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.79100000000000004},"last":0.51000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41272,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330568,"statfs":{"total":96636764160,"available":96594501632,"internally_reserved":0,"allocated":6078464,"data_stored":8505008,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.72099999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.20699999999999999},"max":{"1min":0.65200000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.30499999999999999}]},{"osd":1,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66700000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32400000000000001,"15min":0.222},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.83599999999999997},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.46500000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":0.872},"last":0.31900000000000001}]},{"osd":3,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.78900000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.80900000000000005},"last":0.379}]},{"osd":5,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.65600000000000003,"5min":0.748,"15min":0.748},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.27600000000000002}]},{"osd":6,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.85599999999999998},"last":0.434},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":0.754,"15min":0.877},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575192,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":5688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":5824512,"data_stored":9095888,"data_compressed":837553,"data_compressed_allocated":1253376,"data_compressed_original":4706304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.188,"15min":0.17899999999999999},"max":{"1min":0.41299999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.308},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.437,"5min":0.52600000000000002,"15min":0.59799999999999998},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.27300000000000002,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":0.502,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.32700000000000001}]},{"osd":3,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.252,"5min":0.246,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.63600000000000001},"last":0.307},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.23200000000000001},"max":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.78600000000000003},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33600000000000002,"15min":0.27800000000000002},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.91600000000000004},"last":0.443},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.377,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.76500000000000001},"last":0.42299999999999999}]},{"osd":5,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79300000000000004},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71999999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51100000000000001}]},{"osd":7,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.502},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":8389246,"data_compressed":804970,"data_compressed_allocated":1208320,"data_compressed_original":4132864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2433024,"data_stored":4087688,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":198130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9478144,"data_stored":12781714,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8388734,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11677696,"data_stored":16777888,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16642048,"data_stored":25059630,"data_compressed":2425674,"data_compressed_allocated":3678208,"data_compressed_original":12099584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:00:21.781 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.781 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.781 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.782 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.783 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.784 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.785 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-27T13:31:58.380129+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=31, tm_sec=58, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.786 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.787 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.788 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.789 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-01-27T13:32:11.125539+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=11, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.790 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-01-27T13:32:16.873251+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=16, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.791 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.792 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.793 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.794 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-01-27T13:32:12.220088+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=13, tm_min=32, tm_sec=12, tm_wday=5, tm_yday=27, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=27, tm_hour=14, tm_min=0, tm_sec=13, tm_wday=5, tm_yday=27, tm_isdst=0) 2024-01-27T14:00:21.794 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-27T14:00:34.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:00:34.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:00:41.795 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-27T14:00:41.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.923+0000 7fe1215a9640 1 Processor -- start 2024-01-27T14:00:41.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.923+0000 7fe1215a9640 1 -- start start 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.924+0000 7fe1215a9640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe11c153cd0 0x7fe11c0c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.924+0000 7fe1215a9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe11c06d880 0x7fe11c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.924+0000 7fe1215a9640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c15a870 con 0x7fe11c0c9630 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.924+0000 7fe1215a9640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c159cf0 con 0x7fe11c153cd0 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.924+0000 7fe1215a9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c159fd0 con 0x7fe11c06d880 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.924+0000 7fe11affd640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fe11c153cd0 0x7fe11c0c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.925+0000 7fe113fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe11c06d880 0x7fe11c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.925+0000 7fe11b7fe640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fe11c0c9630 0x7fe11c15d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39222/0 (socket says 172.21.15.46:39222) 2024-01-27T14:00:41.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.925+0000 7fe11b7fe640 1 -- 172.21.15.46:0/2200065370 learned_addr learned my addr 172.21.15.46:0/2200065370 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:41.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.928+0000 7fe113fff640 1 -- 172.21.15.46:0/2200065370 >> v2:172.21.15.46:3300/0 conn(0x7fe11c153cd0 msgr2=0x7fe11c0c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:41.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.928+0000 7fe113fff640 1 --2- 172.21.15.46:0/2200065370 >> v2:172.21.15.46:3300/0 conn(0x7fe11c153cd0 0x7fe11c0c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:41.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.928+0000 7fe113fff640 1 -- 172.21.15.46:0/2200065370 >> v1:172.21.15.46:6789/0 conn(0x7fe11c0c9630 legacy=0x7fe11c15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:41.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.928+0000 7fe113fff640 1 -- 172.21.15.46:0/2200065370 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c15a2b0 con 0x7fe11c06d880 2024-01-27T14:00:41.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.930+0000 7fe113fff640 1 --2- 172.21.15.46:0/2200065370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c0c8fc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe11c1574a0 tx=0x7fe10402b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aacca6c018a2102 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe11a7fc640 1 -- 172.21.15.46:0/2200065370 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104031710 con 0x7fe11c06d880 2024-01-27T14:00:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe11a7fc640 1 -- 172.21.15.46:0/2200065370 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10402f050 con 0x7fe11c06d880 2024-01-27T14:00:41.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe11a7fc640 1 -- 172.21.15.46:0/2200065370 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104031a90 con 0x7fe11c06d880 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 -- 172.21.15.46:0/2200065370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 msgr2=0x7fe11c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 --2- 172.21.15.46:0/2200065370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c0c8fc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe11c1574a0 tx=0x7fe10402b7b0 comp rx=0 tx=0).stop 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 -- 172.21.15.46:0/2200065370 shutdown_connections 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 --2- 172.21.15.46:0/2200065370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c0c8fc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 --2- 172.21.15.46:0/2200065370 >> v2:172.21.15.46:3300/0 conn(0x7fe11c153cd0 0x7fe11c0c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 -- 172.21.15.46:0/2200065370 >> 172.21.15.46:0/2200065370 conn(0x7fe11c06fc00 msgr2=0x7fe11c070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 -- 172.21.15.46:0/2200065370 shutdown_connections 2024-01-27T14:00:41.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.934+0000 7fe1215a9640 1 -- 172.21.15.46:0/2200065370 wait complete. 2024-01-27T14:00:41.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 Processor -- start 2024-01-27T14:00:41.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 -- start start 2024-01-27T14:00:41.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:41.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe11c0c9630 0x7fe11c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:41.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe11c153cd0 0x7fe11c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:41.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0caf80 con 0x7fe11c153cd0 2024-01-27T14:00:41.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0cb260 con 0x7fe11c06d880 2024-01-27T14:00:41.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.936+0000 7fe1215a9640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0cb540 con 0x7fe11c0c9630 2024-01-27T14:00:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.937+0000 7fe11affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.937+0000 7fe113fff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe11c0c9630 0x7fe11c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.937+0000 7fe11b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe11c153cd0 0x7fe11c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.937+0000 7fe11affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c1541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:36338/0 (socket says 172.21.15.46:36338) 2024-01-27T14:00:41.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.937+0000 7fe11affd640 1 -- 172.21.15.46:0/462467176 learned_addr learned my addr 172.21.15.46:0/462467176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.941+0000 7fe11affd640 1 -- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe11c0c9630 msgr2=0x7fe11c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.941+0000 7fe11affd640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe11c0c9630 0x7fe11c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.941+0000 7fe11affd640 1 -- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe11c153cd0 msgr2=0x7fe11c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.941+0000 7fe11affd640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe11c153cd0 0x7fe11c0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:41.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.941+0000 7fe11affd640 1 -- 172.21.15.46:0/462467176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104009400 con 0x7fe11c06d880 2024-01-27T14:00:41.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.943+0000 7fe11affd640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c1541a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e9b0 tx=0x7fe10c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:41.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.948+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c009670 con 0x7fe11c06d880 2024-01-27T14:00:41.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.948+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00c9a0 con 0x7fe11c06d880 2024-01-27T14:00:41.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.948+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00cd50 con 0x7fe11c06d880 2024-01-27T14:00:41.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.948+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c0cb820 con 0x7fe11c06d880 2024-01-27T14:00:41.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.948+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c150180 con 0x7fe11c06d880 2024-01-27T14:00:41.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.949+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c0cba60 con 0x7fe11c06d880 2024-01-27T14:00:41.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.968+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fe10c013470 con 0x7fe11c06d880 2024-01-27T14:00:41.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.968+0000 7fe1137fe640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe0fc06af20 0x7fe0fc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:41.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.968+0000 7fe113fff640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe0fc06af20 0x7fe0fc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:41.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:41.968+0000 7fe113fff640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe0fc06af20 0x7fe0fc06d3e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe104035000 tx=0x7fe104008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:42.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.197+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe10c058a50 con 0x7fe11c06d880 2024-01-27T14:00:42.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.214+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe10c054d90 con 0x7fe11c06d880 2024-01-27T14:00:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.399+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 --> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe11c15cff0 con 0x7fe0fc06af20 2024-01-27T14:00:42.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.409+0000 7fe1137fe640 1 -- 172.21.15.46:0/462467176 <== mgr.4111 v2:172.21.15.46:6800/805234491 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371863 (secure 0 0 0) 0x7fe104041070 con 0x7fe0fc06af20 2024-01-27T14:00:42.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:42.401 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-01-27T14:00:42.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe0fc06af20 msgr2=0x7fe0fc06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe0fc06af20 0x7fe0fc06d3e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe104035000 tx=0x7fe104008030 comp rx=0 tx=0).stop 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 msgr2=0x7fe11c1541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c1541a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e9b0 tx=0x7fe10c00ee70 comp rx=0 tx=0).stop 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 shutdown_connections 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fe0fc06af20 0x7fe0fc06d3e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe11c153cd0 0x7fe11c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fe11c0c9630 0x7fe11c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 --2- 172.21.15.46:0/462467176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe11c06d880 0x7fe11c1541a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 >> 172.21.15.46:0/462467176 conn(0x7fe11c06fc00 msgr2=0x7fe11c0c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:42.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 shutdown_connections 2024-01-27T14:00:42.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.412+0000 7fe1215a9640 1 -- 172.21.15.46:0/462467176 wait complete. 2024-01-27T14:00:42.410 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":884,"stamp":"2024-01-27T14:00:41.956539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38431928,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":1007,"num_read_kb":1043,"num_write":12365,"num_write_kb":342097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14557,"ondisk_log_size":14557,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":381344,"kb_used_data":52832,"kb_used_omap":12,"kb_used_meta":328435,"kb_avail":754593376,"statfs":{"total":773094113280,"available":772703617024,"internally_reserved":0,"allocated":54099968,"data_stored":77794048,"data_compressed":7048892,"data_compressed_allocated":10846208,"data_compressed_original":35938304,"omap_allocated":12752,"internal_metadata":336318000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003879"},"pg_stats":[{"pgid":"2.1f","version":"27'626","reported_seq":674,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:16.655207+0000","last_change":"2024-01-27T14:00:16.655230+0000","last_active":"2024-01-27T14:00:16.655207+0000","last_peered":"2024-01-27T14:00:16.655207+0000","last_clean":"2024-01-27T14:00:16.655207+0000","last_became_active":"2024-01-27T13:32:12.373639+0000","last_became_peered":"2024-01-27T13:32:12.373639+0000","last_unstale":"2024-01-27T14:00:16.655207+0000","last_undegraded":"2024-01-27T14:00:16.655207+0000","last_fullsized":"2024-01-27T14:00:16.655207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'626","last_scrub_stamp":"2024-01-27T14:00:16.655152+0000","last_deep_scrub":"27'626","last_deep_scrub_stamp":"2024-01-27T14:00:16.655152+0000","last_clean_scrub_stamp":"2024-01-27T14:00:16.655152+0000","objects_scrubbed":3,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:08:41.959669+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":622,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"27'26","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.287209+0000","last_change":"2024-01-27T14:00:27.287232+0000","last_active":"2024-01-27T14:00:27.287209+0000","last_peered":"2024-01-27T14:00:27.287209+0000","last_clean":"2024-01-27T14:00:27.287209+0000","last_became_active":"2024-01-27T13:32:13.635784+0000","last_became_peered":"2024-01-27T13:32:13.635784+0000","last_unstale":"2024-01-27T14:00:27.287209+0000","last_undegraded":"2024-01-27T14:00:27.287209+0000","last_fullsized":"2024-01-27T14:00:27.287209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-01-27T14:00:27.287146+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-01-27T14:00:27.287146+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.287146+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:51:53.114793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'150","reported_seq":188,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:34.296908+0000","last_change":"2024-01-27T14:00:34.296955+0000","last_active":"2024-01-27T14:00:34.296908+0000","last_peered":"2024-01-27T14:00:34.296908+0000","last_clean":"2024-01-27T14:00:34.296908+0000","last_became_active":"2024-01-27T13:32:18.346604+0000","last_became_peered":"2024-01-27T13:32:18.346604+0000","last_unstale":"2024-01-27T14:00:34.296908+0000","last_undegraded":"2024-01-27T14:00:34.296908+0000","last_fullsized":"2024-01-27T14:00:34.296908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'150","last_scrub_stamp":"2024-01-27T14:00:34.296773+0000","last_deep_scrub":"27'150","last_deep_scrub_stamp":"2024-01-27T14:00:34.296773+0000","last_clean_scrub_stamp":"2024-01-27T14:00:34.296773+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:38:15.035963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":7299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'717","reported_seq":766,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.335246+0000","last_change":"2024-01-27T14:00:22.335276+0000","last_active":"2024-01-27T14:00:22.335246+0000","last_peered":"2024-01-27T14:00:22.335246+0000","last_clean":"2024-01-27T14:00:22.335246+0000","last_became_active":"2024-01-27T13:32:12.337632+0000","last_became_peered":"2024-01-27T13:32:12.337632+0000","last_unstale":"2024-01-27T14:00:22.335246+0000","last_undegraded":"2024-01-27T14:00:22.335246+0000","last_fullsized":"2024-01-27T14:00:22.335246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'717","last_scrub_stamp":"2024-01-27T14:00:22.335179+0000","last_deep_scrub":"27'717","last_deep_scrub_stamp":"2024-01-27T14:00:22.335179+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.335179+0000","objects_scrubbed":1,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:06.419347+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":712,"num_write_kb":4512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"27'37","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:15.662705+0000","last_change":"2024-01-27T14:00:15.662728+0000","last_active":"2024-01-27T14:00:15.662705+0000","last_peered":"2024-01-27T14:00:15.662705+0000","last_clean":"2024-01-27T14:00:15.662705+0000","last_became_active":"2024-01-27T13:32:13.601802+0000","last_became_peered":"2024-01-27T13:32:13.601802+0000","last_unstale":"2024-01-27T14:00:15.662705+0000","last_undegraded":"2024-01-27T14:00:15.662705+0000","last_fullsized":"2024-01-27T14:00:15.662705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-01-27T14:00:15.662636+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-01-27T14:00:15.662636+0000","last_clean_scrub_stamp":"2024-01-27T14:00:15.662636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:49:08.129681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"27'132","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.264279+0000","last_change":"2024-01-27T14:00:30.264302+0000","last_active":"2024-01-27T14:00:30.264279+0000","last_peered":"2024-01-27T14:00:30.264279+0000","last_clean":"2024-01-27T14:00:30.264279+0000","last_became_active":"2024-01-27T13:32:18.090274+0000","last_became_peered":"2024-01-27T13:32:18.090274+0000","last_unstale":"2024-01-27T14:00:30.264279+0000","last_undegraded":"2024-01-27T14:00:30.264279+0000","last_fullsized":"2024-01-27T14:00:30.264279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'132","last_scrub_stamp":"2024-01-27T14:00:30.264208+0000","last_deep_scrub":"27'132","last_deep_scrub_stamp":"2024-01-27T14:00:30.264208+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.264208+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:57.780367+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'1391","reported_seq":1437,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.605178+0000","last_change":"2024-01-27T14:00:26.605219+0000","last_active":"2024-01-27T14:00:26.605178+0000","last_peered":"2024-01-27T14:00:26.605178+0000","last_clean":"2024-01-27T14:00:26.605178+0000","last_became_active":"2024-01-27T13:32:12.379943+0000","last_became_peered":"2024-01-27T13:32:12.379943+0000","last_unstale":"2024-01-27T14:00:26.605178+0000","last_undegraded":"2024-01-27T14:00:26.605178+0000","last_fullsized":"2024-01-27T14:00:26.605178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1391","last_scrub_stamp":"2024-01-27T14:00:26.605088+0000","last_deep_scrub":"27'1391","last_deep_scrub_stamp":"2024-01-27T14:00:26.605088+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.605088+0000","objects_scrubbed":3,"log_size":1391,"log_dups_size":0,"ondisk_log_size":1391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:02:23.506791+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1379,"num_write_kb":9007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'26","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:34.067489+0000","last_change":"2024-01-27T14:00:34.067512+0000","last_active":"2024-01-27T14:00:34.067489+0000","last_peered":"2024-01-27T14:00:34.067489+0000","last_clean":"2024-01-27T14:00:34.067489+0000","last_became_active":"2024-01-27T13:32:13.638888+0000","last_became_peered":"2024-01-27T13:32:13.638888+0000","last_unstale":"2024-01-27T14:00:34.067489+0000","last_undegraded":"2024-01-27T14:00:34.067489+0000","last_fullsized":"2024-01-27T14:00:34.067489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-01-27T14:00:34.067418+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-01-27T14:00:34.067418+0000","last_clean_scrub_stamp":"2024-01-27T14:00:34.067418+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:20:51.653765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"27'121","reported_seq":159,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.319586+0000","last_change":"2024-01-27T14:00:27.319608+0000","last_active":"2024-01-27T14:00:27.319586+0000","last_peered":"2024-01-27T14:00:27.319586+0000","last_clean":"2024-01-27T14:00:27.319586+0000","last_became_active":"2024-01-27T13:32:18.089448+0000","last_became_peered":"2024-01-27T13:32:18.089448+0000","last_unstale":"2024-01-27T14:00:27.319586+0000","last_undegraded":"2024-01-27T14:00:27.319586+0000","last_fullsized":"2024-01-27T14:00:27.319586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'121","last_scrub_stamp":"2024-01-27T14:00:27.319522+0000","last_deep_scrub":"27'121","last_deep_scrub_stamp":"2024-01-27T14:00:27.319522+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.319522+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:06:19.512842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":9969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'7","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.678406+0000","last_change":"2024-01-27T14:00:23.678431+0000","last_active":"2024-01-27T14:00:23.678406+0000","last_peered":"2024-01-27T14:00:23.678406+0000","last_clean":"2024-01-27T14:00:23.678406+0000","last_became_active":"2024-01-27T13:32:12.375003+0000","last_became_peered":"2024-01-27T13:32:12.375003+0000","last_unstale":"2024-01-27T14:00:23.678406+0000","last_undegraded":"2024-01-27T14:00:23.678406+0000","last_fullsized":"2024-01-27T14:00:23.678406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-01-27T14:00:23.678335+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-01-27T14:00:23.678335+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.678335+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:22:59.503387+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"27'46","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.089969+0000","last_change":"2024-01-27T14:00:31.089992+0000","last_active":"2024-01-27T14:00:31.089969+0000","last_peered":"2024-01-27T14:00:31.089969+0000","last_clean":"2024-01-27T14:00:31.089969+0000","last_became_active":"2024-01-27T13:32:13.638239+0000","last_became_peered":"2024-01-27T13:32:13.638239+0000","last_unstale":"2024-01-27T14:00:31.089969+0000","last_undegraded":"2024-01-27T14:00:31.089969+0000","last_fullsized":"2024-01-27T14:00:31.089969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-01-27T14:00:31.089900+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-01-27T14:00:31.089900+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.089900+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:51:56.917548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"27'126","reported_seq":164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.236971+0000","last_change":"2024-01-27T14:00:31.237011+0000","last_active":"2024-01-27T14:00:31.236971+0000","last_peered":"2024-01-27T14:00:31.236971+0000","last_clean":"2024-01-27T14:00:31.236971+0000","last_became_active":"2024-01-27T13:32:18.091993+0000","last_became_peered":"2024-01-27T13:32:18.091993+0000","last_unstale":"2024-01-27T14:00:31.236971+0000","last_undegraded":"2024-01-27T14:00:31.236971+0000","last_fullsized":"2024-01-27T14:00:31.236971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'126","last_scrub_stamp":"2024-01-27T14:00:31.236887+0000","last_deep_scrub":"27'126","last_deep_scrub_stamp":"2024-01-27T14:00:31.236887+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.236887+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:21:28.727232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.827169+0000","last_change":"2024-01-27T14:00:31.827210+0000","last_active":"2024-01-27T14:00:31.827169+0000","last_peered":"2024-01-27T14:00:31.827169+0000","last_clean":"2024-01-27T14:00:31.827169+0000","last_became_active":"2024-01-27T13:32:13.637876+0000","last_became_peered":"2024-01-27T13:32:13.637876+0000","last_unstale":"2024-01-27T14:00:31.827169+0000","last_undegraded":"2024-01-27T14:00:31.827169+0000","last_fullsized":"2024-01-27T14:00:31.827169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-01-27T14:00:31.827085+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-01-27T14:00:31.827085+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.827085+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:42:23.098815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'619","reported_seq":666,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.610090+0000","last_change":"2024-01-27T14:00:28.610117+0000","last_active":"2024-01-27T14:00:28.610090+0000","last_peered":"2024-01-27T14:00:28.610090+0000","last_clean":"2024-01-27T14:00:28.610090+0000","last_became_active":"2024-01-27T13:32:12.381822+0000","last_became_peered":"2024-01-27T13:32:12.381822+0000","last_unstale":"2024-01-27T14:00:28.610090+0000","last_undegraded":"2024-01-27T14:00:28.610090+0000","last_fullsized":"2024-01-27T14:00:28.610090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'619","last_scrub_stamp":"2024-01-27T14:00:28.610023+0000","last_deep_scrub":"27'619","last_deep_scrub_stamp":"2024-01-27T14:00:28.610023+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.610023+0000","objects_scrubbed":2,"log_size":619,"log_dups_size":0,"ondisk_log_size":619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:12:36.898623+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"27'102","reported_seq":148,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:33.227162+0000","last_change":"2024-01-27T14:00:33.227185+0000","last_active":"2024-01-27T14:00:33.227162+0000","last_peered":"2024-01-27T14:00:33.227162+0000","last_clean":"2024-01-27T14:00:33.227162+0000","last_became_active":"2024-01-27T13:32:51.706791+0000","last_became_peered":"2024-01-27T13:32:51.706791+0000","last_unstale":"2024-01-27T14:00:33.227162+0000","last_undegraded":"2024-01-27T14:00:33.227162+0000","last_fullsized":"2024-01-27T14:00:33.227162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'102","last_scrub_stamp":"2024-01-27T14:00:33.227088+0000","last_deep_scrub":"27'102","last_deep_scrub_stamp":"2024-01-27T14:00:33.227088+0000","last_clean_scrub_stamp":"2024-01-27T14:00:33.227088+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:01:30.421499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81,"num_write_kb":6128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'35","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.321490+0000","last_change":"2024-01-27T14:00:28.321510+0000","last_active":"2024-01-27T14:00:28.321490+0000","last_peered":"2024-01-27T14:00:28.321490+0000","last_clean":"2024-01-27T14:00:28.321490+0000","last_became_active":"2024-01-27T13:32:13.635950+0000","last_became_peered":"2024-01-27T13:32:13.635950+0000","last_unstale":"2024-01-27T14:00:28.321490+0000","last_undegraded":"2024-01-27T14:00:28.321490+0000","last_fullsized":"2024-01-27T14:00:28.321490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-01-27T14:00:28.321429+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-01-27T14:00:28.321429+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.321429+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:08.179850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'1","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.568672+0000","last_change":"2024-01-27T14:00:19.568672+0000","last_active":"2024-01-27T14:00:19.568672+0000","last_peered":"2024-01-27T14:00:19.568672+0000","last_clean":"2024-01-27T14:00:19.568672+0000","last_became_active":"2024-01-27T13:32:12.378041+0000","last_became_peered":"2024-01-27T13:32:12.378041+0000","last_unstale":"2024-01-27T14:00:19.568672+0000","last_undegraded":"2024-01-27T14:00:19.568672+0000","last_fullsized":"2024-01-27T14:00:19.568672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-01-27T14:00:19.568581+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-01-27T14:00:19.568581+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.568581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:04:25.181904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"27'162","reported_seq":201,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.282762+0000","last_change":"2024-01-27T14:00:28.282806+0000","last_active":"2024-01-27T14:00:28.282762+0000","last_peered":"2024-01-27T14:00:28.282762+0000","last_clean":"2024-01-27T14:00:28.282762+0000","last_became_active":"2024-01-27T13:32:18.089984+0000","last_became_peered":"2024-01-27T13:32:18.089984+0000","last_unstale":"2024-01-27T14:00:28.282762+0000","last_undegraded":"2024-01-27T14:00:28.282762+0000","last_fullsized":"2024-01-27T14:00:28.282762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'162","last_scrub_stamp":"2024-01-27T14:00:28.282689+0000","last_deep_scrub":"27'162","last_deep_scrub_stamp":"2024-01-27T14:00:28.282689+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.282689+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:45:38.250391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":10103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"27'33","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.233869+0000","last_change":"2024-01-27T14:00:26.233911+0000","last_active":"2024-01-27T14:00:26.233869+0000","last_peered":"2024-01-27T14:00:26.233869+0000","last_clean":"2024-01-27T14:00:26.233869+0000","last_became_active":"2024-01-27T13:32:51.715639+0000","last_became_peered":"2024-01-27T13:32:51.715639+0000","last_unstale":"2024-01-27T14:00:26.233869+0000","last_undegraded":"2024-01-27T14:00:26.233869+0000","last_fullsized":"2024-01-27T14:00:26.233869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:26.233784+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:26.233784+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.233784+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:43:20.888265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.539181+0000","last_change":"2024-01-27T14:00:17.539181+0000","last_active":"2024-01-27T14:00:17.539181+0000","last_peered":"2024-01-27T14:00:17.539181+0000","last_clean":"2024-01-27T14:00:17.539181+0000","last_became_active":"2024-01-27T13:32:12.375918+0000","last_became_peered":"2024-01-27T13:32:12.375918+0000","last_unstale":"2024-01-27T14:00:17.539181+0000","last_undegraded":"2024-01-27T14:00:17.539181+0000","last_fullsized":"2024-01-27T14:00:17.539181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-01-27T14:00:17.539092+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-01-27T14:00:17.539092+0000","last_clean_scrub_stamp":"2024-01-27T14:00:17.539092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:43:12.193574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"27'135","reported_seq":174,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:32.492266+0000","last_change":"2024-01-27T14:00:32.492289+0000","last_active":"2024-01-27T14:00:32.492266+0000","last_peered":"2024-01-27T14:00:32.492266+0000","last_clean":"2024-01-27T14:00:32.492266+0000","last_became_active":"2024-01-27T13:32:18.349384+0000","last_became_peered":"2024-01-27T13:32:18.349384+0000","last_unstale":"2024-01-27T14:00:32.492266+0000","last_undegraded":"2024-01-27T14:00:32.492266+0000","last_fullsized":"2024-01-27T14:00:32.492266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'135","last_scrub_stamp":"2024-01-27T14:00:32.492198+0000","last_deep_scrub":"27'135","last_deep_scrub_stamp":"2024-01-27T14:00:32.492198+0000","last_clean_scrub_stamp":"2024-01-27T14:00:32.492198+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:10:55.672563+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":8887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"27'31","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.338240+0000","last_change":"2024-01-27T14:00:20.338240+0000","last_active":"2024-01-27T14:00:20.338240+0000","last_peered":"2024-01-27T14:00:20.338240+0000","last_clean":"2024-01-27T14:00:20.338240+0000","last_became_active":"2024-01-27T13:32:13.636525+0000","last_became_peered":"2024-01-27T13:32:13.636525+0000","last_unstale":"2024-01-27T14:00:20.338240+0000","last_undegraded":"2024-01-27T14:00:20.338240+0000","last_fullsized":"2024-01-27T14:00:20.338240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-01-27T14:00:20.338157+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-01-27T14:00:20.338157+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.338157+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:28:54.168944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.595004+0000","last_change":"2024-01-27T14:00:25.595028+0000","last_active":"2024-01-27T14:00:25.595004+0000","last_peered":"2024-01-27T14:00:25.595004+0000","last_clean":"2024-01-27T14:00:25.595004+0000","last_became_active":"2024-01-27T13:32:12.379208+0000","last_became_peered":"2024-01-27T13:32:12.379208+0000","last_unstale":"2024-01-27T14:00:25.595004+0000","last_undegraded":"2024-01-27T14:00:25.595004+0000","last_fullsized":"2024-01-27T14:00:25.595004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-01-27T14:00:25.594927+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-01-27T14:00:25.594927+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.594927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:10:00.424831+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"27'105","reported_seq":144,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.312798+0000","last_change":"2024-01-27T14:00:25.312835+0000","last_active":"2024-01-27T14:00:25.312798+0000","last_peered":"2024-01-27T14:00:25.312798+0000","last_clean":"2024-01-27T14:00:25.312798+0000","last_became_active":"2024-01-27T13:32:18.087319+0000","last_became_peered":"2024-01-27T13:32:18.087319+0000","last_unstale":"2024-01-27T14:00:25.312798+0000","last_undegraded":"2024-01-27T14:00:25.312798+0000","last_fullsized":"2024-01-27T14:00:25.312798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'105","last_scrub_stamp":"2024-01-27T14:00:25.312716+0000","last_deep_scrub":"27'105","last_deep_scrub_stamp":"2024-01-27T14:00:25.312716+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.312716+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:09:39.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":9310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"27'40","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.592024+0000","last_change":"2024-01-27T14:00:20.592024+0000","last_active":"2024-01-27T14:00:20.592024+0000","last_peered":"2024-01-27T14:00:20.592024+0000","last_clean":"2024-01-27T14:00:20.592024+0000","last_became_active":"2024-01-27T13:32:13.531114+0000","last_became_peered":"2024-01-27T13:32:13.531114+0000","last_unstale":"2024-01-27T14:00:20.592024+0000","last_undegraded":"2024-01-27T14:00:20.592024+0000","last_fullsized":"2024-01-27T14:00:20.592024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:20.591931+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:20.591931+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.591931+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:46:45.471623+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'10","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.670830+0000","last_change":"2024-01-27T14:00:21.670830+0000","last_active":"2024-01-27T14:00:21.670830+0000","last_peered":"2024-01-27T14:00:21.670830+0000","last_clean":"2024-01-27T14:00:21.670830+0000","last_became_active":"2024-01-27T13:32:12.382130+0000","last_became_peered":"2024-01-27T13:32:12.382130+0000","last_unstale":"2024-01-27T14:00:21.670830+0000","last_undegraded":"2024-01-27T14:00:21.670830+0000","last_fullsized":"2024-01-27T14:00:21.670830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-01-27T14:00:21.670741+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-01-27T14:00:21.670741+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.670741+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:08:46.975258+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'127","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:32.237493+0000","last_change":"2024-01-27T14:00:32.237523+0000","last_active":"2024-01-27T14:00:32.237493+0000","last_peered":"2024-01-27T14:00:32.237493+0000","last_clean":"2024-01-27T14:00:32.237493+0000","last_became_active":"2024-01-27T13:32:18.349801+0000","last_became_peered":"2024-01-27T13:32:18.349801+0000","last_unstale":"2024-01-27T14:00:32.237493+0000","last_undegraded":"2024-01-27T14:00:32.237493+0000","last_fullsized":"2024-01-27T14:00:32.237493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'127","last_scrub_stamp":"2024-01-27T14:00:32.237398+0000","last_deep_scrub":"27'127","last_deep_scrub_stamp":"2024-01-27T14:00:32.237398+0000","last_clean_scrub_stamp":"2024-01-27T14:00:32.237398+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:55:25.835567+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":6403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.241332+0000","last_change":"2024-01-27T14:00:26.241361+0000","last_active":"2024-01-27T14:00:26.241332+0000","last_peered":"2024-01-27T14:00:26.241332+0000","last_clean":"2024-01-27T14:00:26.241332+0000","last_became_active":"2024-01-27T13:32:13.635126+0000","last_became_peered":"2024-01-27T13:32:13.635126+0000","last_unstale":"2024-01-27T14:00:26.241332+0000","last_undegraded":"2024-01-27T14:00:26.241332+0000","last_fullsized":"2024-01-27T14:00:26.241332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:26.241269+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:26.241269+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.241269+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:19:55.792865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'309","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.539362+0000","last_change":"2024-01-27T14:00:21.539362+0000","last_active":"2024-01-27T14:00:21.539362+0000","last_peered":"2024-01-27T14:00:21.539362+0000","last_clean":"2024-01-27T14:00:21.539362+0000","last_became_active":"2024-01-27T13:32:12.379356+0000","last_became_peered":"2024-01-27T13:32:12.379356+0000","last_unstale":"2024-01-27T14:00:21.539362+0000","last_undegraded":"2024-01-27T14:00:21.539362+0000","last_fullsized":"2024-01-27T14:00:21.539362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'309","last_scrub_stamp":"2024-01-27T14:00:21.539271+0000","last_deep_scrub":"27'309","last_deep_scrub_stamp":"2024-01-27T14:00:21.539271+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.539271+0000","objects_scrubbed":1,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:07:34.378679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"27'143","reported_seq":191,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:37.165063+0000","last_change":"2024-01-27T14:00:37.165089+0000","last_active":"2024-01-27T14:00:37.165063+0000","last_peered":"2024-01-27T14:00:37.165063+0000","last_clean":"2024-01-27T14:00:37.165063+0000","last_became_active":"2024-01-27T13:32:51.674245+0000","last_became_peered":"2024-01-27T13:32:51.674245+0000","last_unstale":"2024-01-27T14:00:37.165063+0000","last_undegraded":"2024-01-27T14:00:37.165063+0000","last_fullsized":"2024-01-27T14:00:37.165063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'143","last_scrub_stamp":"2024-01-27T14:00:37.164973+0000","last_deep_scrub":"27'143","last_deep_scrub_stamp":"2024-01-27T14:00:37.164973+0000","last_clean_scrub_stamp":"2024-01-27T14:00:37.164973+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:18:09.472593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":7973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'31","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.494478+0000","last_change":"2024-01-27T14:00:23.494499+0000","last_active":"2024-01-27T14:00:23.494478+0000","last_peered":"2024-01-27T14:00:23.494478+0000","last_clean":"2024-01-27T14:00:23.494478+0000","last_became_active":"2024-01-27T13:32:13.531623+0000","last_became_peered":"2024-01-27T13:32:13.531623+0000","last_unstale":"2024-01-27T14:00:23.494478+0000","last_undegraded":"2024-01-27T14:00:23.494478+0000","last_fullsized":"2024-01-27T14:00:23.494478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-01-27T14:00:23.494408+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-01-27T14:00:23.494408+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.494408+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:15:44.406717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.644728+0000","last_change":"2024-01-27T14:00:24.644754+0000","last_active":"2024-01-27T14:00:24.644728+0000","last_peered":"2024-01-27T14:00:24.644728+0000","last_clean":"2024-01-27T14:00:24.644728+0000","last_became_active":"2024-01-27T13:32:12.378717+0000","last_became_peered":"2024-01-27T13:32:12.378717+0000","last_unstale":"2024-01-27T14:00:24.644728+0000","last_undegraded":"2024-01-27T14:00:24.644728+0000","last_fullsized":"2024-01-27T14:00:24.644728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-01-27T14:00:24.644647+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-01-27T14:00:24.644647+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.644647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:44:44.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"27'116","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.592755+0000","last_change":"2024-01-27T14:00:31.592779+0000","last_active":"2024-01-27T14:00:31.592755+0000","last_peered":"2024-01-27T14:00:31.592755+0000","last_clean":"2024-01-27T14:00:31.592755+0000","last_became_active":"2024-01-27T13:32:18.347013+0000","last_became_peered":"2024-01-27T13:32:18.347013+0000","last_unstale":"2024-01-27T14:00:31.592755+0000","last_undegraded":"2024-01-27T14:00:31.592755+0000","last_fullsized":"2024-01-27T14:00:31.592755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'116","last_scrub_stamp":"2024-01-27T14:00:31.592676+0000","last_deep_scrub":"27'116","last_deep_scrub_stamp":"2024-01-27T14:00:31.592676+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.592676+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:15:45.460173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":8672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.049158+0000","last_change":"2024-01-27T14:00:30.049186+0000","last_active":"2024-01-27T14:00:30.049158+0000","last_peered":"2024-01-27T14:00:30.049158+0000","last_clean":"2024-01-27T14:00:30.049158+0000","last_became_active":"2024-01-27T13:32:13.636161+0000","last_became_peered":"2024-01-27T13:32:13.636161+0000","last_unstale":"2024-01-27T14:00:30.049158+0000","last_undegraded":"2024-01-27T14:00:30.049158+0000","last_fullsized":"2024-01-27T14:00:30.049158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:30.049068+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:30.049068+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.049068+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:19:59.600664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.574630+0000","last_change":"2024-01-27T14:00:20.574651+0000","last_active":"2024-01-27T14:00:20.574630+0000","last_peered":"2024-01-27T14:00:20.574630+0000","last_clean":"2024-01-27T14:00:20.574630+0000","last_became_active":"2024-01-27T13:32:12.378824+0000","last_became_peered":"2024-01-27T13:32:12.378824+0000","last_unstale":"2024-01-27T14:00:20.574630+0000","last_undegraded":"2024-01-27T14:00:20.574630+0000","last_fullsized":"2024-01-27T14:00:20.574630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-01-27T14:00:20.574560+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-01-27T14:00:20.574560+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.574560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:36:12.712391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'170","reported_seq":210,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.523791+0000","last_change":"2024-01-27T14:00:31.523817+0000","last_active":"2024-01-27T14:00:31.523791+0000","last_peered":"2024-01-27T14:00:31.523791+0000","last_clean":"2024-01-27T14:00:31.523791+0000","last_became_active":"2024-01-27T13:32:18.089262+0000","last_became_peered":"2024-01-27T13:32:18.089262+0000","last_unstale":"2024-01-27T14:00:31.523791+0000","last_undegraded":"2024-01-27T14:00:31.523791+0000","last_fullsized":"2024-01-27T14:00:31.523791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'170","last_scrub_stamp":"2024-01-27T14:00:31.523712+0000","last_deep_scrub":"27'170","last_deep_scrub_stamp":"2024-01-27T14:00:31.523712+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.523712+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:08:10.306859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.322331+0000","last_change":"2024-01-27T14:00:22.322368+0000","last_active":"2024-01-27T14:00:22.322331+0000","last_peered":"2024-01-27T14:00:22.322331+0000","last_clean":"2024-01-27T14:00:22.322331+0000","last_became_active":"2024-01-27T13:32:13.638391+0000","last_became_peered":"2024-01-27T13:32:13.638391+0000","last_unstale":"2024-01-27T14:00:22.322331+0000","last_undegraded":"2024-01-27T14:00:22.322331+0000","last_fullsized":"2024-01-27T14:00:22.322331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-01-27T14:00:22.322240+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-01-27T14:00:22.322240+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.322240+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:39:21.535801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.150004+0000","last_change":"2024-01-27T14:00:23.150026+0000","last_active":"2024-01-27T14:00:23.150004+0000","last_peered":"2024-01-27T14:00:23.150004+0000","last_clean":"2024-01-27T14:00:23.150004+0000","last_became_active":"2024-01-27T13:32:12.372876+0000","last_became_peered":"2024-01-27T13:32:12.372876+0000","last_unstale":"2024-01-27T14:00:23.150004+0000","last_undegraded":"2024-01-27T14:00:23.150004+0000","last_fullsized":"2024-01-27T14:00:23.150004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-01-27T14:00:23.149936+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-01-27T14:00:23.149936+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.149936+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:36:15.287767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"27'103","reported_seq":143,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.537160+0000","last_change":"2024-01-27T14:00:30.537182+0000","last_active":"2024-01-27T14:00:30.537160+0000","last_peered":"2024-01-27T14:00:30.537160+0000","last_clean":"2024-01-27T14:00:30.537160+0000","last_became_active":"2024-01-27T13:32:18.078016+0000","last_became_peered":"2024-01-27T13:32:18.078016+0000","last_unstale":"2024-01-27T14:00:30.537160+0000","last_undegraded":"2024-01-27T14:00:30.537160+0000","last_fullsized":"2024-01-27T14:00:30.537160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'103","last_scrub_stamp":"2024-01-27T14:00:30.537097+0000","last_deep_scrub":"27'103","last_deep_scrub_stamp":"2024-01-27T14:00:30.537097+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.537097+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:14.221111+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":6049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"27'33","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.509066+0000","last_change":"2024-01-27T14:00:24.509089+0000","last_active":"2024-01-27T14:00:24.509066+0000","last_peered":"2024-01-27T14:00:24.509066+0000","last_clean":"2024-01-27T14:00:24.509066+0000","last_became_active":"2024-01-27T13:32:13.531684+0000","last_became_peered":"2024-01-27T13:32:13.531684+0000","last_unstale":"2024-01-27T14:00:24.509066+0000","last_undegraded":"2024-01-27T14:00:24.509066+0000","last_fullsized":"2024-01-27T14:00:24.509066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:24.508996+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:24.508996+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.508996+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:11:35.495984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'896","reported_seq":1835,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.283916+0000","last_change":"2024-01-27T14:00:17.283941+0000","last_active":"2024-01-27T14:00:17.283916+0000","last_peered":"2024-01-27T14:00:17.283916+0000","last_clean":"2024-01-27T14:00:17.283916+0000","last_became_active":"2024-01-27T13:32:12.378776+0000","last_became_peered":"2024-01-27T13:32:12.378776+0000","last_unstale":"2024-01-27T14:00:17.283916+0000","last_undegraded":"2024-01-27T14:00:17.283916+0000","last_fullsized":"2024-01-27T14:00:17.283916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'896","last_scrub_stamp":"2024-01-27T14:00:17.283831+0000","last_deep_scrub":"27'896","last_deep_scrub_stamp":"2024-01-27T14:00:17.283831+0000","last_clean_scrub_stamp":"2024-01-27T14:00:17.283831+0000","objects_scrubbed":1,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:15:50.567015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198130,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":891,"num_write_kb":943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'141","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.521466+0000","last_change":"2024-01-27T14:00:29.521466+0000","last_active":"2024-01-27T14:00:29.521466+0000","last_peered":"2024-01-27T14:00:29.521466+0000","last_clean":"2024-01-27T14:00:29.521466+0000","last_became_active":"2024-01-27T13:32:18.076091+0000","last_became_peered":"2024-01-27T13:32:18.076091+0000","last_unstale":"2024-01-27T14:00:29.521466+0000","last_undegraded":"2024-01-27T14:00:29.521466+0000","last_fullsized":"2024-01-27T14:00:29.521466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'141","last_scrub_stamp":"2024-01-27T14:00:29.521368+0000","last_deep_scrub":"27'141","last_deep_scrub_stamp":"2024-01-27T14:00:29.521368+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.521368+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:09:59.339115+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":10872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"27'25","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.637628+0000","last_change":"2024-01-27T14:00:26.637661+0000","last_active":"2024-01-27T14:00:26.637628+0000","last_peered":"2024-01-27T14:00:26.637628+0000","last_clean":"2024-01-27T14:00:26.637628+0000","last_became_active":"2024-01-27T13:32:13.639206+0000","last_became_peered":"2024-01-27T13:32:13.639206+0000","last_unstale":"2024-01-27T14:00:26.637628+0000","last_undegraded":"2024-01-27T14:00:26.637628+0000","last_fullsized":"2024-01-27T14:00:26.637628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-01-27T14:00:26.637554+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-01-27T14:00:26.637554+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.637554+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:42:17.909284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'433","reported_seq":482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.614961+0000","last_change":"2024-01-27T14:00:27.614985+0000","last_active":"2024-01-27T14:00:27.614961+0000","last_peered":"2024-01-27T14:00:27.614961+0000","last_clean":"2024-01-27T14:00:27.614961+0000","last_became_active":"2024-01-27T13:32:12.380792+0000","last_became_peered":"2024-01-27T13:32:12.380792+0000","last_unstale":"2024-01-27T14:00:27.614961+0000","last_undegraded":"2024-01-27T14:00:27.614961+0000","last_fullsized":"2024-01-27T14:00:27.614961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'433","last_scrub_stamp":"2024-01-27T14:00:27.614885+0000","last_deep_scrub":"27'433","last_deep_scrub_stamp":"2024-01-27T14:00:27.614885+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.614885+0000","objects_scrubbed":1,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:06:19.808206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4087528,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":428,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"27'130","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.643130+0000","last_change":"2024-01-27T14:00:29.643181+0000","last_active":"2024-01-27T14:00:29.643130+0000","last_peered":"2024-01-27T14:00:29.643130+0000","last_clean":"2024-01-27T14:00:29.643130+0000","last_became_active":"2024-01-27T13:32:18.346599+0000","last_became_peered":"2024-01-27T13:32:18.346599+0000","last_unstale":"2024-01-27T14:00:29.643130+0000","last_undegraded":"2024-01-27T14:00:29.643130+0000","last_fullsized":"2024-01-27T14:00:29.643130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'130","last_scrub_stamp":"2024-01-27T14:00:29.643055+0000","last_deep_scrub":"27'130","last_deep_scrub_stamp":"2024-01-27T14:00:29.643055+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.643055+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:01:26.837466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":9704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.304138+0000","last_change":"2024-01-27T14:00:21.304175+0000","last_active":"2024-01-27T14:00:21.304138+0000","last_peered":"2024-01-27T14:00:21.304138+0000","last_clean":"2024-01-27T14:00:21.304138+0000","last_became_active":"2024-01-27T13:32:13.636851+0000","last_became_peered":"2024-01-27T13:32:13.636851+0000","last_unstale":"2024-01-27T14:00:21.304138+0000","last_undegraded":"2024-01-27T14:00:21.304138+0000","last_fullsized":"2024-01-27T14:00:21.304138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-01-27T14:00:21.304067+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-01-27T14:00:21.304067+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.304067+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:30:54.464477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'5","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.079678+0000","last_change":"2024-01-27T14:00:25.079731+0000","last_active":"2024-01-27T14:00:25.079678+0000","last_peered":"2024-01-27T14:00:25.079678+0000","last_clean":"2024-01-27T14:00:25.079678+0000","last_became_active":"2024-01-27T13:32:12.378461+0000","last_became_peered":"2024-01-27T13:32:12.378461+0000","last_unstale":"2024-01-27T14:00:25.079678+0000","last_undegraded":"2024-01-27T14:00:25.079678+0000","last_fullsized":"2024-01-27T14:00:25.079678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-01-27T14:00:25.079598+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-01-27T14:00:25.079598+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.079598+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:30:58.240009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":207,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.706193+0000","last_change":"2024-01-27T14:00:22.706242+0000","last_active":"2024-01-27T14:00:22.706193+0000","last_peered":"2024-01-27T14:00:22.706193+0000","last_clean":"2024-01-27T14:00:22.706193+0000","last_became_active":"2024-01-27T13:31:59.953840+0000","last_became_peered":"2024-01-27T13:31:59.953840+0000","last_unstale":"2024-01-27T14:00:22.706193+0000","last_undegraded":"2024-01-27T14:00:22.706193+0000","last_fullsized":"2024-01-27T14:00:22.706193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-01-27T14:00:22.706099+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-01-27T14:00:22.706099+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.706099+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:12:17.670952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"27'154","reported_seq":194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:32.875484+0000","last_change":"2024-01-27T14:00:32.875508+0000","last_active":"2024-01-27T14:00:32.875484+0000","last_peered":"2024-01-27T14:00:32.875484+0000","last_clean":"2024-01-27T14:00:32.875484+0000","last_became_active":"2024-01-27T13:32:18.346601+0000","last_became_peered":"2024-01-27T13:32:18.346601+0000","last_unstale":"2024-01-27T14:00:32.875484+0000","last_undegraded":"2024-01-27T14:00:32.875484+0000","last_fullsized":"2024-01-27T14:00:32.875484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'154","last_scrub_stamp":"2024-01-27T14:00:32.875414+0000","last_deep_scrub":"27'154","last_deep_scrub_stamp":"2024-01-27T14:00:32.875414+0000","last_clean_scrub_stamp":"2024-01-27T14:00:32.875414+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:51.907120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'32","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:37.594585+0000","last_change":"2024-01-27T14:00:37.594607+0000","last_active":"2024-01-27T14:00:37.594585+0000","last_peered":"2024-01-27T14:00:37.594585+0000","last_clean":"2024-01-27T14:00:37.594585+0000","last_became_active":"2024-01-27T13:32:51.718398+0000","last_became_peered":"2024-01-27T13:32:51.718398+0000","last_unstale":"2024-01-27T14:00:37.594585+0000","last_undegraded":"2024-01-27T14:00:37.594585+0000","last_fullsized":"2024-01-27T14:00:37.594585+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-01-27T14:00:37.594483+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-01-27T14:00:37.594483+0000","last_clean_scrub_stamp":"2024-01-27T14:00:37.594483+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:34:45.040946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'1","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.296404+0000","last_change":"2024-01-27T14:00:20.296424+0000","last_active":"2024-01-27T14:00:20.296404+0000","last_peered":"2024-01-27T14:00:20.296404+0000","last_clean":"2024-01-27T14:00:20.296404+0000","last_became_active":"2024-01-27T13:32:12.384655+0000","last_became_peered":"2024-01-27T13:32:12.384655+0000","last_unstale":"2024-01-27T14:00:20.296404+0000","last_undegraded":"2024-01-27T14:00:20.296404+0000","last_fullsized":"2024-01-27T14:00:20.296404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-01-27T14:00:20.296337+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-01-27T14:00:20.296337+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.296337+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:37:47.169196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"27'132","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:33.899826+0000","last_change":"2024-01-27T14:00:33.899850+0000","last_active":"2024-01-27T14:00:33.899826+0000","last_peered":"2024-01-27T14:00:33.899826+0000","last_clean":"2024-01-27T14:00:33.899826+0000","last_became_active":"2024-01-27T13:32:18.346669+0000","last_became_peered":"2024-01-27T13:32:18.346669+0000","last_unstale":"2024-01-27T14:00:33.899826+0000","last_undegraded":"2024-01-27T14:00:33.899826+0000","last_fullsized":"2024-01-27T14:00:33.899826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'132","last_scrub_stamp":"2024-01-27T14:00:33.899741+0000","last_deep_scrub":"27'132","last_deep_scrub_stamp":"2024-01-27T14:00:33.899741+0000","last_clean_scrub_stamp":"2024-01-27T14:00:33.899741+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:55:27.497909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":6638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"27'36","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.235717+0000","last_change":"2024-01-27T14:00:24.235740+0000","last_active":"2024-01-27T14:00:24.235717+0000","last_peered":"2024-01-27T14:00:24.235717+0000","last_clean":"2024-01-27T14:00:24.235717+0000","last_became_active":"2024-01-27T13:32:51.673276+0000","last_became_peered":"2024-01-27T13:32:51.673276+0000","last_unstale":"2024-01-27T14:00:24.235717+0000","last_undegraded":"2024-01-27T14:00:24.235717+0000","last_fullsized":"2024-01-27T14:00:24.235717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-01-27T14:00:24.235644+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-01-27T14:00:24.235644+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.235644+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:48.758046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.508861+0000","last_change":"2024-01-27T14:00:22.508884+0000","last_active":"2024-01-27T14:00:22.508861+0000","last_peered":"2024-01-27T14:00:22.508861+0000","last_clean":"2024-01-27T14:00:22.508861+0000","last_became_active":"2024-01-27T13:32:12.381985+0000","last_became_peered":"2024-01-27T13:32:12.381985+0000","last_unstale":"2024-01-27T14:00:22.508861+0000","last_undegraded":"2024-01-27T14:00:22.508861+0000","last_fullsized":"2024-01-27T14:00:22.508861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-01-27T14:00:22.508790+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-01-27T14:00:22.508790+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.508790+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:46:56.171606+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"27'178","reported_seq":217,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.623278+0000","last_change":"2024-01-27T14:00:28.623301+0000","last_active":"2024-01-27T14:00:28.623278+0000","last_peered":"2024-01-27T14:00:28.623278+0000","last_clean":"2024-01-27T14:00:28.623278+0000","last_became_active":"2024-01-27T13:32:18.090368+0000","last_became_peered":"2024-01-27T13:32:18.090368+0000","last_unstale":"2024-01-27T14:00:28.623278+0000","last_undegraded":"2024-01-27T14:00:28.623278+0000","last_fullsized":"2024-01-27T14:00:28.623278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'178","last_scrub_stamp":"2024-01-27T14:00:28.623211+0000","last_deep_scrub":"27'178","last_deep_scrub_stamp":"2024-01-27T14:00:28.623211+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.623211+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:55:22.221379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":15130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"27'33","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:35.547349+0000","last_change":"2024-01-27T14:00:35.547370+0000","last_active":"2024-01-27T14:00:35.547349+0000","last_peered":"2024-01-27T14:00:35.547349+0000","last_clean":"2024-01-27T14:00:35.547349+0000","last_became_active":"2024-01-27T13:32:13.638750+0000","last_became_peered":"2024-01-27T13:32:13.638750+0000","last_unstale":"2024-01-27T14:00:35.547349+0000","last_undegraded":"2024-01-27T14:00:35.547349+0000","last_fullsized":"2024-01-27T14:00:35.547349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:35.547283+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:35.547283+0000","last_clean_scrub_stamp":"2024-01-27T14:00:35.547283+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:15:49.414780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.246602+0000","last_change":"2024-01-27T14:00:18.246627+0000","last_active":"2024-01-27T14:00:18.246602+0000","last_peered":"2024-01-27T14:00:18.246602+0000","last_clean":"2024-01-27T14:00:18.246602+0000","last_became_active":"2024-01-27T13:32:12.378868+0000","last_became_peered":"2024-01-27T13:32:12.378868+0000","last_unstale":"2024-01-27T14:00:18.246602+0000","last_undegraded":"2024-01-27T14:00:18.246602+0000","last_fullsized":"2024-01-27T14:00:18.246602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-01-27T14:00:18.246537+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-01-27T14:00:18.246537+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.246537+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:56:05.432420+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"27'133","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:37.098236+0000","last_change":"2024-01-27T14:00:37.098264+0000","last_active":"2024-01-27T14:00:37.098236+0000","last_peered":"2024-01-27T14:00:37.098236+0000","last_clean":"2024-01-27T14:00:37.098236+0000","last_became_active":"2024-01-27T13:32:18.346943+0000","last_became_peered":"2024-01-27T13:32:18.346943+0000","last_unstale":"2024-01-27T14:00:37.098236+0000","last_undegraded":"2024-01-27T14:00:37.098236+0000","last_fullsized":"2024-01-27T14:00:37.098236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'133","last_scrub_stamp":"2024-01-27T14:00:37.098152+0000","last_deep_scrub":"27'133","last_deep_scrub_stamp":"2024-01-27T14:00:37.098152+0000","last_clean_scrub_stamp":"2024-01-27T14:00:37.098152+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:10:49.618180+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":6651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"27'21","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:34.562275+0000","last_change":"2024-01-27T14:00:34.562316+0000","last_active":"2024-01-27T14:00:34.562275+0000","last_peered":"2024-01-27T14:00:34.562275+0000","last_clean":"2024-01-27T14:00:34.562275+0000","last_became_active":"2024-01-27T13:32:13.638224+0000","last_became_peered":"2024-01-27T13:32:13.638224+0000","last_unstale":"2024-01-27T14:00:34.562275+0000","last_undegraded":"2024-01-27T14:00:34.562275+0000","last_fullsized":"2024-01-27T14:00:34.562275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-01-27T14:00:34.562196+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-01-27T14:00:34.562196+0000","last_clean_scrub_stamp":"2024-01-27T14:00:34.562196+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:03:53.464861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'3","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.367484+0000","last_change":"2024-01-27T14:00:19.367524+0000","last_active":"2024-01-27T14:00:19.367484+0000","last_peered":"2024-01-27T14:00:19.367484+0000","last_clean":"2024-01-27T14:00:19.367484+0000","last_became_active":"2024-01-27T13:32:12.380728+0000","last_became_peered":"2024-01-27T13:32:12.380728+0000","last_unstale":"2024-01-27T14:00:19.367484+0000","last_undegraded":"2024-01-27T14:00:19.367484+0000","last_fullsized":"2024-01-27T14:00:19.367484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-01-27T14:00:19.367401+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-01-27T14:00:19.367401+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.367401+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:39:54.855192+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"27'153","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.322185+0000","last_change":"2024-01-27T14:00:26.322185+0000","last_active":"2024-01-27T14:00:26.322185+0000","last_peered":"2024-01-27T14:00:26.322185+0000","last_clean":"2024-01-27T14:00:26.322185+0000","last_became_active":"2024-01-27T13:32:18.089036+0000","last_became_peered":"2024-01-27T13:32:18.089036+0000","last_unstale":"2024-01-27T14:00:26.322185+0000","last_undegraded":"2024-01-27T14:00:26.322185+0000","last_fullsized":"2024-01-27T14:00:26.322185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'153","last_scrub_stamp":"2024-01-27T14:00:26.322026+0000","last_deep_scrub":"27'153","last_deep_scrub_stamp":"2024-01-27T14:00:26.322026+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.322026+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:05:58.222236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":10566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"27'31","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:36.575177+0000","last_change":"2024-01-27T14:00:36.575216+0000","last_active":"2024-01-27T14:00:36.575177+0000","last_peered":"2024-01-27T14:00:36.575177+0000","last_clean":"2024-01-27T14:00:36.575177+0000","last_became_active":"2024-01-27T13:32:13.642080+0000","last_became_peered":"2024-01-27T13:32:13.642080+0000","last_unstale":"2024-01-27T14:00:36.575177+0000","last_undegraded":"2024-01-27T14:00:36.575177+0000","last_fullsized":"2024-01-27T14:00:36.575177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-01-27T14:00:36.575079+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-01-27T14:00:36.575079+0000","last_clean_scrub_stamp":"2024-01-27T14:00:36.575079+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:38:26.267648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'19","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.273439+0000","last_change":"2024-01-27T14:00:19.273465+0000","last_active":"2024-01-27T14:00:19.273439+0000","last_peered":"2024-01-27T14:00:19.273439+0000","last_clean":"2024-01-27T14:00:19.273439+0000","last_became_active":"2024-01-27T13:32:12.381321+0000","last_became_peered":"2024-01-27T13:32:12.381321+0000","last_unstale":"2024-01-27T14:00:19.273439+0000","last_undegraded":"2024-01-27T14:00:19.273439+0000","last_fullsized":"2024-01-27T14:00:19.273439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-01-27T14:00:19.273370+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-01-27T14:00:19.273370+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.273370+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:45:07.025269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"27'137","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.656310+0000","last_change":"2024-01-27T14:00:27.656332+0000","last_active":"2024-01-27T14:00:27.656310+0000","last_peered":"2024-01-27T14:00:27.656310+0000","last_clean":"2024-01-27T14:00:27.656310+0000","last_became_active":"2024-01-27T13:32:18.075351+0000","last_became_peered":"2024-01-27T13:32:18.075351+0000","last_unstale":"2024-01-27T14:00:27.656310+0000","last_undegraded":"2024-01-27T14:00:27.656310+0000","last_fullsized":"2024-01-27T14:00:27.656310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'137","last_scrub_stamp":"2024-01-27T14:00:27.656239+0000","last_deep_scrub":"27'137","last_deep_scrub_stamp":"2024-01-27T14:00:27.656239+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.656239+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:46.687945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":8266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'29","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.688392+0000","last_change":"2024-01-27T14:00:27.688413+0000","last_active":"2024-01-27T14:00:27.688392+0000","last_peered":"2024-01-27T14:00:27.688392+0000","last_clean":"2024-01-27T14:00:27.688392+0000","last_became_active":"2024-01-27T13:32:13.634081+0000","last_became_peered":"2024-01-27T13:32:13.634081+0000","last_unstale":"2024-01-27T14:00:27.688392+0000","last_undegraded":"2024-01-27T14:00:27.688392+0000","last_fullsized":"2024-01-27T14:00:27.688392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-01-27T14:00:27.688334+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-01-27T14:00:27.688334+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.688334+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:03:23.750275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.656340+0000","last_change":"2024-01-27T14:00:22.656363+0000","last_active":"2024-01-27T14:00:22.656340+0000","last_peered":"2024-01-27T14:00:22.656340+0000","last_clean":"2024-01-27T14:00:22.656340+0000","last_became_active":"2024-01-27T13:32:12.384210+0000","last_became_peered":"2024-01-27T13:32:12.384210+0000","last_unstale":"2024-01-27T14:00:22.656340+0000","last_undegraded":"2024-01-27T14:00:22.656340+0000","last_fullsized":"2024-01-27T14:00:22.656340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-01-27T14:00:22.656275+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-01-27T14:00:22.656275+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.656275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:12:17.621128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'118","reported_seq":156,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:35.250115+0000","last_change":"2024-01-27T14:00:35.250172+0000","last_active":"2024-01-27T14:00:35.250115+0000","last_peered":"2024-01-27T14:00:35.250115+0000","last_clean":"2024-01-27T14:00:35.250115+0000","last_became_active":"2024-01-27T13:32:18.350742+0000","last_became_peered":"2024-01-27T13:32:18.350742+0000","last_unstale":"2024-01-27T14:00:35.250115+0000","last_undegraded":"2024-01-27T14:00:35.250115+0000","last_fullsized":"2024-01-27T14:00:35.250115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'118","last_scrub_stamp":"2024-01-27T14:00:35.249999+0000","last_deep_scrub":"27'118","last_deep_scrub_stamp":"2024-01-27T14:00:35.249999+0000","last_clean_scrub_stamp":"2024-01-27T14:00:35.249999+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:36:28.167834+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":8731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'42","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:33.558939+0000","last_change":"2024-01-27T14:00:33.558960+0000","last_active":"2024-01-27T14:00:33.558939+0000","last_peered":"2024-01-27T14:00:33.558939+0000","last_clean":"2024-01-27T14:00:33.558939+0000","last_became_active":"2024-01-27T13:32:13.637851+0000","last_became_peered":"2024-01-27T13:32:13.637851+0000","last_unstale":"2024-01-27T14:00:33.558939+0000","last_undegraded":"2024-01-27T14:00:33.558939+0000","last_fullsized":"2024-01-27T14:00:33.558939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-01-27T14:00:33.558873+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-01-27T14:00:33.558873+0000","last_clean_scrub_stamp":"2024-01-27T14:00:33.558873+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:55:27.157041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'8","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.161017+0000","last_change":"2024-01-27T14:00:22.161038+0000","last_active":"2024-01-27T14:00:22.161017+0000","last_peered":"2024-01-27T14:00:22.161017+0000","last_clean":"2024-01-27T14:00:22.161017+0000","last_became_active":"2024-01-27T13:32:12.356373+0000","last_became_peered":"2024-01-27T13:32:12.356373+0000","last_unstale":"2024-01-27T14:00:22.161017+0000","last_undegraded":"2024-01-27T14:00:22.161017+0000","last_fullsized":"2024-01-27T14:00:22.161017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-01-27T14:00:22.160949+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-01-27T14:00:22.160949+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.160949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:04:27.774272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"27'100","reported_seq":139,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:36.206345+0000","last_change":"2024-01-27T14:00:36.206397+0000","last_active":"2024-01-27T14:00:36.206345+0000","last_peered":"2024-01-27T14:00:36.206345+0000","last_clean":"2024-01-27T14:00:36.206345+0000","last_became_active":"2024-01-27T13:32:18.350691+0000","last_became_peered":"2024-01-27T13:32:18.350691+0000","last_unstale":"2024-01-27T14:00:36.206345+0000","last_undegraded":"2024-01-27T14:00:36.206345+0000","last_fullsized":"2024-01-27T14:00:36.206345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'100","last_scrub_stamp":"2024-01-27T14:00:36.206223+0000","last_deep_scrub":"27'100","last_deep_scrub_stamp":"2024-01-27T14:00:36.206223+0000","last_clean_scrub_stamp":"2024-01-27T14:00:36.206223+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:35:06.473235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":4755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.629867+0000","last_change":"2024-01-27T14:00:21.629910+0000","last_active":"2024-01-27T14:00:21.629867+0000","last_peered":"2024-01-27T14:00:21.629867+0000","last_clean":"2024-01-27T14:00:21.629867+0000","last_became_active":"2024-01-27T13:32:13.600497+0000","last_became_peered":"2024-01-27T13:32:13.600497+0000","last_unstale":"2024-01-27T14:00:21.629867+0000","last_undegraded":"2024-01-27T14:00:21.629867+0000","last_fullsized":"2024-01-27T14:00:21.629867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-01-27T14:00:21.629781+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-01-27T14:00:21.629781+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.629781+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:09:56.459685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'11","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:17.633407+0000","last_change":"2024-01-27T14:00:17.633431+0000","last_active":"2024-01-27T14:00:17.633407+0000","last_peered":"2024-01-27T14:00:17.633407+0000","last_clean":"2024-01-27T14:00:17.633407+0000","last_became_active":"2024-01-27T13:32:12.381865+0000","last_became_peered":"2024-01-27T13:32:12.381865+0000","last_unstale":"2024-01-27T14:00:17.633407+0000","last_undegraded":"2024-01-27T14:00:17.633407+0000","last_fullsized":"2024-01-27T14:00:17.633407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-01-27T14:00:17.633339+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-01-27T14:00:17.633339+0000","last_clean_scrub_stamp":"2024-01-27T14:00:17.633339+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:12:12.598191+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'140","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:36.142395+0000","last_change":"2024-01-27T14:00:36.142427+0000","last_active":"2024-01-27T14:00:36.142395+0000","last_peered":"2024-01-27T14:00:36.142395+0000","last_clean":"2024-01-27T14:00:36.142395+0000","last_became_active":"2024-01-27T13:32:18.346291+0000","last_became_peered":"2024-01-27T13:32:18.346291+0000","last_unstale":"2024-01-27T14:00:36.142395+0000","last_undegraded":"2024-01-27T14:00:36.142395+0000","last_fullsized":"2024-01-27T14:00:36.142395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'140","last_scrub_stamp":"2024-01-27T14:00:36.142303+0000","last_deep_scrub":"27'140","last_deep_scrub_stamp":"2024-01-27T14:00:36.142303+0000","last_clean_scrub_stamp":"2024-01-27T14:00:36.142303+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:58:43.060339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":9178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"27'34","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:32.565905+0000","last_change":"2024-01-27T14:00:32.565942+0000","last_active":"2024-01-27T14:00:32.565905+0000","last_peered":"2024-01-27T14:00:32.565905+0000","last_clean":"2024-01-27T14:00:32.565905+0000","last_became_active":"2024-01-27T13:32:13.634967+0000","last_became_peered":"2024-01-27T13:32:13.634967+0000","last_unstale":"2024-01-27T14:00:32.565905+0000","last_undegraded":"2024-01-27T14:00:32.565905+0000","last_fullsized":"2024-01-27T14:00:32.565905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-01-27T14:00:32.565809+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-01-27T14:00:32.565809+0000","last_clean_scrub_stamp":"2024-01-27T14:00:32.565809+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:24:51.597516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'864","reported_seq":911,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.685751+0000","last_change":"2024-01-27T14:00:20.685796+0000","last_active":"2024-01-27T14:00:20.685751+0000","last_peered":"2024-01-27T14:00:20.685751+0000","last_clean":"2024-01-27T14:00:20.685751+0000","last_became_active":"2024-01-27T13:32:12.378837+0000","last_became_peered":"2024-01-27T13:32:12.378837+0000","last_unstale":"2024-01-27T14:00:20.685751+0000","last_undegraded":"2024-01-27T14:00:20.685751+0000","last_fullsized":"2024-01-27T14:00:20.685751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'864","last_scrub_stamp":"2024-01-27T14:00:20.685664+0000","last_deep_scrub":"27'864","last_deep_scrub_stamp":"2024-01-27T14:00:20.685664+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.685664+0000","objects_scrubbed":4,"log_size":864,"log_dups_size":0,"ondisk_log_size":864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:49:13.152708+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":4566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'134","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.499020+0000","last_change":"2024-01-27T14:00:28.499044+0000","last_active":"2024-01-27T14:00:28.499020+0000","last_peered":"2024-01-27T14:00:28.499020+0000","last_clean":"2024-01-27T14:00:28.499020+0000","last_became_active":"2024-01-27T13:32:18.074215+0000","last_became_peered":"2024-01-27T13:32:18.074215+0000","last_unstale":"2024-01-27T14:00:28.499020+0000","last_undegraded":"2024-01-27T14:00:28.499020+0000","last_fullsized":"2024-01-27T14:00:28.499020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'134","last_scrub_stamp":"2024-01-27T14:00:28.498948+0000","last_deep_scrub":"27'134","last_deep_scrub_stamp":"2024-01-27T14:00:28.498948+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.498948+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:51:54.326595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":8218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'29","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.286255+0000","last_change":"2024-01-27T14:00:24.286298+0000","last_active":"2024-01-27T14:00:24.286255+0000","last_peered":"2024-01-27T14:00:24.286255+0000","last_clean":"2024-01-27T14:00:24.286255+0000","last_became_active":"2024-01-27T13:32:13.642369+0000","last_became_peered":"2024-01-27T13:32:13.642369+0000","last_unstale":"2024-01-27T14:00:24.286255+0000","last_undegraded":"2024-01-27T14:00:24.286255+0000","last_fullsized":"2024-01-27T14:00:24.286255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-01-27T14:00:24.286153+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-01-27T14:00:24.286153+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.286153+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:44:43.785004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'605","reported_seq":651,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.587383+0000","last_change":"2024-01-27T14:00:18.587424+0000","last_active":"2024-01-27T14:00:18.587383+0000","last_peered":"2024-01-27T14:00:18.587383+0000","last_clean":"2024-01-27T14:00:18.587383+0000","last_became_active":"2024-01-27T13:32:12.377546+0000","last_became_peered":"2024-01-27T13:32:12.377546+0000","last_unstale":"2024-01-27T14:00:18.587383+0000","last_undegraded":"2024-01-27T14:00:18.587383+0000","last_fullsized":"2024-01-27T14:00:18.587383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'605","last_scrub_stamp":"2024-01-27T14:00:18.587307+0000","last_deep_scrub":"27'605","last_deep_scrub_stamp":"2024-01-27T14:00:18.587307+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.587307+0000","objects_scrubbed":2,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:01:32.639892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":605,"num_write_kb":602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"27'142","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.263662+0000","last_change":"2024-01-27T14:00:29.263686+0000","last_active":"2024-01-27T14:00:29.263662+0000","last_peered":"2024-01-27T14:00:29.263662+0000","last_clean":"2024-01-27T14:00:29.263662+0000","last_became_active":"2024-01-27T13:32:18.090054+0000","last_became_peered":"2024-01-27T13:32:18.090054+0000","last_unstale":"2024-01-27T14:00:29.263662+0000","last_undegraded":"2024-01-27T14:00:29.263662+0000","last_fullsized":"2024-01-27T14:00:29.263662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'142","last_scrub_stamp":"2024-01-27T14:00:29.263577+0000","last_deep_scrub":"27'142","last_deep_scrub_stamp":"2024-01-27T14:00:29.263577+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.263577+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:21:14.395902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":22998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"27'34","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.582749+0000","last_change":"2024-01-27T14:00:23.582772+0000","last_active":"2024-01-27T14:00:23.582749+0000","last_peered":"2024-01-27T14:00:23.582749+0000","last_clean":"2024-01-27T14:00:23.582749+0000","last_became_active":"2024-01-27T13:32:13.601743+0000","last_became_peered":"2024-01-27T13:32:13.601743+0000","last_unstale":"2024-01-27T14:00:23.582749+0000","last_undegraded":"2024-01-27T14:00:23.582749+0000","last_fullsized":"2024-01-27T14:00:23.582749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-01-27T14:00:23.582681+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-01-27T14:00:23.582681+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.582681+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:54:22.693144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.078845+0000","last_change":"2024-01-27T14:00:26.078874+0000","last_active":"2024-01-27T14:00:26.078845+0000","last_peered":"2024-01-27T14:00:26.078845+0000","last_clean":"2024-01-27T14:00:26.078845+0000","last_became_active":"2024-01-27T13:32:12.379265+0000","last_became_peered":"2024-01-27T13:32:12.379265+0000","last_unstale":"2024-01-27T14:00:26.078845+0000","last_undegraded":"2024-01-27T14:00:26.078845+0000","last_fullsized":"2024-01-27T14:00:26.078845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-01-27T14:00:26.078732+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-01-27T14:00:26.078732+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.078732+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:38:10.162901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"27'115","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:32.355833+0000","last_change":"2024-01-27T14:00:32.355868+0000","last_active":"2024-01-27T14:00:32.355833+0000","last_peered":"2024-01-27T14:00:32.355833+0000","last_clean":"2024-01-27T14:00:32.355833+0000","last_became_active":"2024-01-27T13:32:18.090411+0000","last_became_peered":"2024-01-27T13:32:18.090411+0000","last_unstale":"2024-01-27T14:00:32.355833+0000","last_undegraded":"2024-01-27T14:00:32.355833+0000","last_fullsized":"2024-01-27T14:00:32.355833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'115","last_scrub_stamp":"2024-01-27T14:00:32.355762+0000","last_deep_scrub":"27'115","last_deep_scrub_stamp":"2024-01-27T14:00:32.355762+0000","last_clean_scrub_stamp":"2024-01-27T14:00:32.355762+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:58:39.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":6746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.164201+0000","last_change":"2024-01-27T14:00:20.164242+0000","last_active":"2024-01-27T14:00:20.164201+0000","last_peered":"2024-01-27T14:00:20.164201+0000","last_clean":"2024-01-27T14:00:20.164201+0000","last_became_active":"2024-01-27T13:32:13.603166+0000","last_became_peered":"2024-01-27T13:32:13.603166+0000","last_unstale":"2024-01-27T14:00:20.164201+0000","last_undegraded":"2024-01-27T14:00:20.164201+0000","last_fullsized":"2024-01-27T14:00:20.164201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:20.164121+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:20.164121+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.164121+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:22:04.872406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.617284+0000","last_change":"2024-01-27T14:00:24.617330+0000","last_active":"2024-01-27T14:00:24.617284+0000","last_peered":"2024-01-27T14:00:24.617284+0000","last_clean":"2024-01-27T14:00:24.617284+0000","last_became_active":"2024-01-27T13:32:12.384991+0000","last_became_peered":"2024-01-27T13:32:12.384991+0000","last_unstale":"2024-01-27T14:00:24.617284+0000","last_undegraded":"2024-01-27T14:00:24.617284+0000","last_fullsized":"2024-01-27T14:00:24.617284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-01-27T14:00:24.617185+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-01-27T14:00:24.617185+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.617185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:17.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"27'145","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:33.325888+0000","last_change":"2024-01-27T14:00:33.325915+0000","last_active":"2024-01-27T14:00:33.325888+0000","last_peered":"2024-01-27T14:00:33.325888+0000","last_clean":"2024-01-27T14:00:33.325888+0000","last_became_active":"2024-01-27T13:32:18.346593+0000","last_became_peered":"2024-01-27T13:32:18.346593+0000","last_unstale":"2024-01-27T14:00:33.325888+0000","last_undegraded":"2024-01-27T14:00:33.325888+0000","last_fullsized":"2024-01-27T14:00:33.325888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'145","last_scrub_stamp":"2024-01-27T14:00:33.325803+0000","last_deep_scrub":"27'145","last_deep_scrub_stamp":"2024-01-27T14:00:33.325803+0000","last_clean_scrub_stamp":"2024-01-27T14:00:33.325803+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:10:45.845832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":131,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"27'135","reported_seq":176,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.624953+0000","last_change":"2024-01-27T14:00:30.624976+0000","last_active":"2024-01-27T14:00:30.624953+0000","last_peered":"2024-01-27T14:00:30.624953+0000","last_clean":"2024-01-27T14:00:30.624953+0000","last_became_active":"2024-01-27T13:32:18.346854+0000","last_became_peered":"2024-01-27T13:32:18.346854+0000","last_unstale":"2024-01-27T14:00:30.624953+0000","last_undegraded":"2024-01-27T14:00:30.624953+0000","last_fullsized":"2024-01-27T14:00:30.624953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'135","last_scrub_stamp":"2024-01-27T14:00:30.624878+0000","last_deep_scrub":"27'135","last_deep_scrub_stamp":"2024-01-27T14:00:30.624878+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.624878+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T21:21:09.803168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":11460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.522482+0000","last_change":"2024-01-27T14:00:25.522503+0000","last_active":"2024-01-27T14:00:25.522482+0000","last_peered":"2024-01-27T14:00:25.522482+0000","last_clean":"2024-01-27T14:00:25.522482+0000","last_became_active":"2024-01-27T13:32:13.634721+0000","last_became_peered":"2024-01-27T13:32:13.634721+0000","last_unstale":"2024-01-27T14:00:25.522482+0000","last_undegraded":"2024-01-27T14:00:25.522482+0000","last_fullsized":"2024-01-27T14:00:25.522482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:25.522408+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:25.522408+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.522408+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:58:25.512991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.112890+0000","last_change":"2024-01-27T14:00:24.112912+0000","last_active":"2024-01-27T14:00:24.112890+0000","last_peered":"2024-01-27T14:00:24.112890+0000","last_clean":"2024-01-27T14:00:24.112890+0000","last_became_active":"2024-01-27T13:32:12.377414+0000","last_became_peered":"2024-01-27T13:32:12.377414+0000","last_unstale":"2024-01-27T14:00:24.112890+0000","last_undegraded":"2024-01-27T14:00:24.112890+0000","last_fullsized":"2024-01-27T14:00:24.112890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-01-27T14:00:24.112800+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-01-27T14:00:24.112800+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.112800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:07:36.952208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"27'150","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:34.933497+0000","last_change":"2024-01-27T14:00:34.933538+0000","last_active":"2024-01-27T14:00:34.933497+0000","last_peered":"2024-01-27T14:00:34.933497+0000","last_clean":"2024-01-27T14:00:34.933497+0000","last_became_active":"2024-01-27T13:32:51.706729+0000","last_became_peered":"2024-01-27T13:32:51.706729+0000","last_unstale":"2024-01-27T14:00:34.933497+0000","last_undegraded":"2024-01-27T14:00:34.933497+0000","last_fullsized":"2024-01-27T14:00:34.933497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'150","last_scrub_stamp":"2024-01-27T14:00:34.933396+0000","last_deep_scrub":"27'150","last_deep_scrub_stamp":"2024-01-27T14:00:34.933396+0000","last_clean_scrub_stamp":"2024-01-27T14:00:34.933396+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:01:32.127807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":19231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,0],"acting":[6,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"27'40","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.253122+0000","last_change":"2024-01-27T14:00:25.253144+0000","last_active":"2024-01-27T14:00:25.253122+0000","last_peered":"2024-01-27T14:00:25.253122+0000","last_clean":"2024-01-27T14:00:25.253122+0000","last_became_active":"2024-01-27T13:32:13.633577+0000","last_became_peered":"2024-01-27T13:32:13.633577+0000","last_unstale":"2024-01-27T14:00:25.253122+0000","last_undegraded":"2024-01-27T14:00:25.253122+0000","last_fullsized":"2024-01-27T14:00:25.253122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:25.253060+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:25.253060+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.253060+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:03:04.518331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.302622+0000","last_change":"2024-01-27T14:00:24.302644+0000","last_active":"2024-01-27T14:00:24.302622+0000","last_peered":"2024-01-27T14:00:24.302622+0000","last_clean":"2024-01-27T14:00:24.302622+0000","last_became_active":"2024-01-27T13:32:12.378634+0000","last_became_peered":"2024-01-27T13:32:12.378634+0000","last_unstale":"2024-01-27T14:00:24.302622+0000","last_undegraded":"2024-01-27T14:00:24.302622+0000","last_fullsized":"2024-01-27T14:00:24.302622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-01-27T14:00:24.302556+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-01-27T14:00:24.302556+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.302556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:58:24.293139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'692","reported_seq":739,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.673451+0000","last_change":"2024-01-27T14:00:23.673477+0000","last_active":"2024-01-27T14:00:23.673451+0000","last_peered":"2024-01-27T14:00:23.673451+0000","last_clean":"2024-01-27T14:00:23.673451+0000","last_became_active":"2024-01-27T13:32:12.384438+0000","last_became_peered":"2024-01-27T13:32:12.384438+0000","last_unstale":"2024-01-27T14:00:23.673451+0000","last_undegraded":"2024-01-27T14:00:23.673451+0000","last_fullsized":"2024-01-27T14:00:23.673451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'692","last_scrub_stamp":"2024-01-27T14:00:23.673381+0000","last_deep_scrub":"27'692","last_deep_scrub_stamp":"2024-01-27T14:00:23.673381+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.673381+0000","objects_scrubbed":1,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:36.477349+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":4459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"27'39","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.668014+0000","last_change":"2024-01-27T14:00:25.668035+0000","last_active":"2024-01-27T14:00:25.668014+0000","last_peered":"2024-01-27T14:00:25.668014+0000","last_clean":"2024-01-27T14:00:25.668014+0000","last_became_active":"2024-01-27T13:32:13.639046+0000","last_became_peered":"2024-01-27T13:32:13.639046+0000","last_unstale":"2024-01-27T14:00:25.668014+0000","last_undegraded":"2024-01-27T14:00:25.668014+0000","last_fullsized":"2024-01-27T14:00:25.668014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-01-27T14:00:25.667949+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-01-27T14:00:25.667949+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.667949+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:37:48.205550+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"27'81","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.258188+0000","last_change":"2024-01-27T14:00:23.258212+0000","last_active":"2024-01-27T14:00:23.258188+0000","last_peered":"2024-01-27T14:00:23.258188+0000","last_clean":"2024-01-27T14:00:23.258188+0000","last_became_active":"2024-01-27T13:32:18.073535+0000","last_became_peered":"2024-01-27T13:32:18.073535+0000","last_unstale":"2024-01-27T14:00:23.258188+0000","last_undegraded":"2024-01-27T14:00:23.258188+0000","last_fullsized":"2024-01-27T14:00:23.258188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-01-27T14:00:23.258119+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-01-27T14:00:23.258119+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.258119+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:37:32.355516+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":5759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'710","reported_seq":756,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.357015+0000","last_change":"2024-01-27T14:00:23.357042+0000","last_active":"2024-01-27T14:00:23.357015+0000","last_peered":"2024-01-27T14:00:23.357015+0000","last_clean":"2024-01-27T14:00:23.357015+0000","last_became_active":"2024-01-27T13:32:12.371949+0000","last_became_peered":"2024-01-27T13:32:12.371949+0000","last_unstale":"2024-01-27T14:00:23.357015+0000","last_undegraded":"2024-01-27T14:00:23.357015+0000","last_fullsized":"2024-01-27T14:00:23.357015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'710","last_scrub_stamp":"2024-01-27T14:00:23.356942+0000","last_deep_scrub":"27'710","last_deep_scrub_stamp":"2024-01-27T14:00:23.356942+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.356942+0000","objects_scrubbed":1,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:53:02.318474+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":704,"num_write_kb":4438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'31","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.342983+0000","last_change":"2024-01-27T14:00:21.343007+0000","last_active":"2024-01-27T14:00:21.342983+0000","last_peered":"2024-01-27T14:00:21.342983+0000","last_clean":"2024-01-27T14:00:21.342983+0000","last_became_active":"2024-01-27T13:32:13.637139+0000","last_became_peered":"2024-01-27T13:32:13.637139+0000","last_unstale":"2024-01-27T14:00:21.342983+0000","last_undegraded":"2024-01-27T14:00:21.342983+0000","last_fullsized":"2024-01-27T14:00:21.342983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'31","last_scrub_stamp":"2024-01-27T14:00:21.342922+0000","last_deep_scrub":"27'31","last_deep_scrub_stamp":"2024-01-27T14:00:21.342922+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.342922+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:34:59.292195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'143","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.380598+0000","last_change":"2024-01-27T14:00:31.380624+0000","last_active":"2024-01-27T14:00:31.380598+0000","last_peered":"2024-01-27T14:00:31.380598+0000","last_clean":"2024-01-27T14:00:31.380598+0000","last_became_active":"2024-01-27T13:32:18.089591+0000","last_became_peered":"2024-01-27T13:32:18.089591+0000","last_unstale":"2024-01-27T14:00:31.380598+0000","last_undegraded":"2024-01-27T14:00:31.380598+0000","last_fullsized":"2024-01-27T14:00:31.380598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'143","last_scrub_stamp":"2024-01-27T14:00:31.380520+0000","last_deep_scrub":"27'143","last_deep_scrub_stamp":"2024-01-27T14:00:31.380520+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.380520+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:54:09.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"27'46","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.717980+0000","last_change":"2024-01-27T14:00:28.718000+0000","last_active":"2024-01-27T14:00:28.717980+0000","last_peered":"2024-01-27T14:00:28.717980+0000","last_clean":"2024-01-27T14:00:28.717980+0000","last_became_active":"2024-01-27T13:32:13.634492+0000","last_became_peered":"2024-01-27T13:32:13.634492+0000","last_unstale":"2024-01-27T14:00:28.717980+0000","last_undegraded":"2024-01-27T14:00:28.717980+0000","last_fullsized":"2024-01-27T14:00:28.717980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-01-27T14:00:28.717913+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-01-27T14:00:28.717913+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.717913+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:54:27.828376+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"27'45","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.317393+0000","last_change":"2024-01-27T14:00:21.317413+0000","last_active":"2024-01-27T14:00:21.317393+0000","last_peered":"2024-01-27T14:00:21.317393+0000","last_clean":"2024-01-27T14:00:21.317393+0000","last_became_active":"2024-01-27T13:32:13.600762+0000","last_became_peered":"2024-01-27T13:32:13.600762+0000","last_unstale":"2024-01-27T14:00:21.317393+0000","last_undegraded":"2024-01-27T14:00:21.317393+0000","last_fullsized":"2024-01-27T14:00:21.317393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-01-27T14:00:21.317333+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-01-27T14:00:21.317333+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.317333+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:32:56.333320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"27'45","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:35.112284+0000","last_change":"2024-01-27T14:00:35.112307+0000","last_active":"2024-01-27T14:00:35.112284+0000","last_peered":"2024-01-27T14:00:35.112284+0000","last_clean":"2024-01-27T14:00:35.112284+0000","last_became_active":"2024-01-27T13:32:13.639259+0000","last_became_peered":"2024-01-27T13:32:13.639259+0000","last_unstale":"2024-01-27T14:00:35.112284+0000","last_undegraded":"2024-01-27T14:00:35.112284+0000","last_fullsized":"2024-01-27T14:00:35.112284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-01-27T14:00:35.112221+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-01-27T14:00:35.112221+0000","last_clean_scrub_stamp":"2024-01-27T14:00:35.112221+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T17:54:13.637055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:24.621092+0000","last_change":"2024-01-27T14:00:24.621130+0000","last_active":"2024-01-27T14:00:24.621092+0000","last_peered":"2024-01-27T14:00:24.621092+0000","last_clean":"2024-01-27T14:00:24.621092+0000","last_became_active":"2024-01-27T13:32:13.635063+0000","last_became_peered":"2024-01-27T13:32:13.635063+0000","last_unstale":"2024-01-27T14:00:24.621092+0000","last_undegraded":"2024-01-27T14:00:24.621092+0000","last_fullsized":"2024-01-27T14:00:24.621092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:24.621003+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:24.621003+0000","last_clean_scrub_stamp":"2024-01-27T14:00:24.621003+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:07:23.324990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'24","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:20.268844+0000","last_change":"2024-01-27T14:00:20.268844+0000","last_active":"2024-01-27T14:00:20.268844+0000","last_peered":"2024-01-27T14:00:20.268844+0000","last_clean":"2024-01-27T14:00:20.268844+0000","last_became_active":"2024-01-27T13:32:13.637759+0000","last_became_peered":"2024-01-27T13:32:13.637759+0000","last_unstale":"2024-01-27T14:00:20.268844+0000","last_undegraded":"2024-01-27T14:00:20.268844+0000","last_fullsized":"2024-01-27T14:00:20.268844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-01-27T14:00:20.268747+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-01-27T14:00:20.268747+0000","last_clean_scrub_stamp":"2024-01-27T14:00:20.268747+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T18:07:33.108155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"27'28","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.505851+0000","last_change":"2024-01-27T14:00:26.505873+0000","last_active":"2024-01-27T14:00:26.505851+0000","last_peered":"2024-01-27T14:00:26.505851+0000","last_clean":"2024-01-27T14:00:26.505851+0000","last_became_active":"2024-01-27T13:32:13.635275+0000","last_became_peered":"2024-01-27T13:32:13.635275+0000","last_unstale":"2024-01-27T14:00:26.505851+0000","last_undegraded":"2024-01-27T14:00:26.505851+0000","last_fullsized":"2024-01-27T14:00:26.505851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-01-27T14:00:26.505776+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-01-27T14:00:26.505776+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.505776+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:03:05.771047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"27'43","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.662283+0000","last_change":"2024-01-27T14:00:25.662305+0000","last_active":"2024-01-27T14:00:25.662283+0000","last_peered":"2024-01-27T14:00:25.662283+0000","last_clean":"2024-01-27T14:00:25.662283+0000","last_became_active":"2024-01-27T13:32:13.632156+0000","last_became_peered":"2024-01-27T13:32:13.632156+0000","last_unstale":"2024-01-27T14:00:25.662283+0000","last_undegraded":"2024-01-27T14:00:25.662283+0000","last_fullsized":"2024-01-27T14:00:25.662283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-01-27T14:00:25.662206+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-01-27T14:00:25.662206+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.662206+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T22:46:50.541898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"27'30","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.269274+0000","last_change":"2024-01-27T14:00:19.269274+0000","last_active":"2024-01-27T14:00:19.269274+0000","last_peered":"2024-01-27T14:00:19.269274+0000","last_clean":"2024-01-27T14:00:19.269274+0000","last_became_active":"2024-01-27T13:32:13.637592+0000","last_became_peered":"2024-01-27T13:32:13.637592+0000","last_unstale":"2024-01-27T14:00:19.269274+0000","last_undegraded":"2024-01-27T14:00:19.269274+0000","last_fullsized":"2024-01-27T14:00:19.269274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-01-27T14:00:19.269181+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-01-27T14:00:19.269181+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.269181+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:36:11.407012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"27'34","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:33.046261+0000","last_change":"2024-01-27T14:00:33.046282+0000","last_active":"2024-01-27T14:00:33.046261+0000","last_peered":"2024-01-27T14:00:33.046261+0000","last_clean":"2024-01-27T14:00:33.046261+0000","last_became_active":"2024-01-27T13:32:13.636016+0000","last_became_peered":"2024-01-27T13:32:13.636016+0000","last_unstale":"2024-01-27T14:00:33.046261+0000","last_undegraded":"2024-01-27T14:00:33.046261+0000","last_fullsized":"2024-01-27T14:00:33.046261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-01-27T14:00:33.046199+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-01-27T14:00:33.046199+0000","last_clean_scrub_stamp":"2024-01-27T14:00:33.046199+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:16.730213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"27'42","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.297778+0000","last_change":"2024-01-27T14:00:18.297798+0000","last_active":"2024-01-27T14:00:18.297778+0000","last_peered":"2024-01-27T14:00:18.297778+0000","last_clean":"2024-01-27T14:00:18.297778+0000","last_became_active":"2024-01-27T13:32:13.637690+0000","last_became_peered":"2024-01-27T13:32:13.637690+0000","last_unstale":"2024-01-27T14:00:18.297778+0000","last_undegraded":"2024-01-27T14:00:18.297778+0000","last_fullsized":"2024-01-27T14:00:18.297778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-01-27T14:00:18.297720+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-01-27T14:00:18.297720+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.297720+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:04:23.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.064074+0000","last_change":"2024-01-27T14:00:29.064097+0000","last_active":"2024-01-27T14:00:29.064074+0000","last_peered":"2024-01-27T14:00:29.064074+0000","last_clean":"2024-01-27T14:00:29.064074+0000","last_became_active":"2024-01-27T13:32:13.602070+0000","last_became_peered":"2024-01-27T13:32:13.602070+0000","last_unstale":"2024-01-27T14:00:29.064074+0000","last_undegraded":"2024-01-27T14:00:29.064074+0000","last_fullsized":"2024-01-27T14:00:29.064074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-01-27T14:00:29.063997+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-01-27T14:00:29.063997+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.063997+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:03:08.329269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"27'45","reported_seq":90,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.595710+0000","last_change":"2024-01-27T14:00:22.595732+0000","last_active":"2024-01-27T14:00:22.595710+0000","last_peered":"2024-01-27T14:00:22.595710+0000","last_clean":"2024-01-27T14:00:22.595710+0000","last_became_active":"2024-01-27T13:32:13.600508+0000","last_became_peered":"2024-01-27T13:32:13.600508+0000","last_unstale":"2024-01-27T14:00:22.595710+0000","last_undegraded":"2024-01-27T14:00:22.595710+0000","last_fullsized":"2024-01-27T14:00:22.595710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-01-27T14:00:22.595644+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-01-27T14:00:22.595644+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.595644+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:03:18.657586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"27'40","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.799758+0000","last_change":"2024-01-27T14:00:30.799779+0000","last_active":"2024-01-27T14:00:30.799758+0000","last_peered":"2024-01-27T14:00:30.799758+0000","last_clean":"2024-01-27T14:00:30.799758+0000","last_became_active":"2024-01-27T13:32:13.637852+0000","last_became_peered":"2024-01-27T13:32:13.637852+0000","last_unstale":"2024-01-27T14:00:30.799758+0000","last_undegraded":"2024-01-27T14:00:30.799758+0000","last_fullsized":"2024-01-27T14:00:30.799758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:30.799691+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:30.799691+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.799691+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:37:53.337292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"27'34","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.745201+0000","last_change":"2024-01-27T14:00:21.745244+0000","last_active":"2024-01-27T14:00:21.745201+0000","last_peered":"2024-01-27T14:00:21.745201+0000","last_clean":"2024-01-27T14:00:21.745201+0000","last_became_active":"2024-01-27T13:32:13.601050+0000","last_became_peered":"2024-01-27T13:32:13.601050+0000","last_unstale":"2024-01-27T14:00:21.745201+0000","last_undegraded":"2024-01-27T14:00:21.745201+0000","last_fullsized":"2024-01-27T14:00:21.745201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-01-27T14:00:21.745128+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-01-27T14:00:21.745128+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.745128+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:07:49.424667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"27'43","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:22.273960+0000","last_change":"2024-01-27T14:00:22.273993+0000","last_active":"2024-01-27T14:00:22.273960+0000","last_peered":"2024-01-27T14:00:22.273960+0000","last_clean":"2024-01-27T14:00:22.273960+0000","last_became_active":"2024-01-27T13:32:13.633062+0000","last_became_peered":"2024-01-27T13:32:13.633062+0000","last_unstale":"2024-01-27T14:00:22.273960+0000","last_undegraded":"2024-01-27T14:00:22.273960+0000","last_fullsized":"2024-01-27T14:00:22.273960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'43","last_scrub_stamp":"2024-01-27T14:00:22.273890+0000","last_deep_scrub":"27'43","last_deep_scrub_stamp":"2024-01-27T14:00:22.273890+0000","last_clean_scrub_stamp":"2024-01-27T14:00:22.273890+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:56:52.229159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"27'38","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:21.149729+0000","last_change":"2024-01-27T14:00:21.149753+0000","last_active":"2024-01-27T14:00:21.149729+0000","last_peered":"2024-01-27T14:00:21.149729+0000","last_clean":"2024-01-27T14:00:21.149729+0000","last_became_active":"2024-01-27T13:32:13.603181+0000","last_became_peered":"2024-01-27T13:32:13.603181+0000","last_unstale":"2024-01-27T14:00:21.149729+0000","last_undegraded":"2024-01-27T14:00:21.149729+0000","last_fullsized":"2024-01-27T14:00:21.149729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-01-27T14:00:21.149660+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-01-27T14:00:21.149660+0000","last_clean_scrub_stamp":"2024-01-27T14:00:21.149660+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:01:35.202245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.049828+0000","last_change":"2024-01-27T14:00:27.049868+0000","last_active":"2024-01-27T14:00:27.049828+0000","last_peered":"2024-01-27T14:00:27.049828+0000","last_clean":"2024-01-27T14:00:27.049828+0000","last_became_active":"2024-01-27T13:32:13.600120+0000","last_became_peered":"2024-01-27T13:32:13.600120+0000","last_unstale":"2024-01-27T14:00:27.049828+0000","last_undegraded":"2024-01-27T14:00:27.049828+0000","last_fullsized":"2024-01-27T14:00:27.049828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-01-27T14:00:27.049721+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-01-27T14:00:27.049721+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.049721+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T15:53:06.011253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"27'40","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:27.542444+0000","last_change":"2024-01-27T14:00:27.542467+0000","last_active":"2024-01-27T14:00:27.542444+0000","last_peered":"2024-01-27T14:00:27.542444+0000","last_clean":"2024-01-27T14:00:27.542444+0000","last_became_active":"2024-01-27T13:32:13.639107+0000","last_became_peered":"2024-01-27T13:32:13.639107+0000","last_unstale":"2024-01-27T14:00:27.542444+0000","last_undegraded":"2024-01-27T14:00:27.542444+0000","last_fullsized":"2024-01-27T14:00:27.542444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:27.542379+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:27.542379+0000","last_clean_scrub_stamp":"2024-01-27T14:00:27.542379+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:19:57.093976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'34","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:19.612289+0000","last_change":"2024-01-27T14:00:19.612311+0000","last_active":"2024-01-27T14:00:19.612289+0000","last_peered":"2024-01-27T14:00:19.612289+0000","last_clean":"2024-01-27T14:00:19.612289+0000","last_became_active":"2024-01-27T13:32:13.530542+0000","last_became_peered":"2024-01-27T13:32:13.530542+0000","last_unstale":"2024-01-27T14:00:19.612289+0000","last_undegraded":"2024-01-27T14:00:19.612289+0000","last_fullsized":"2024-01-27T14:00:19.612289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-01-27T14:00:19.612224+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-01-27T14:00:19.612224+0000","last_clean_scrub_stamp":"2024-01-27T14:00:19.612224+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:17:12.231779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"27'37","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.363735+0000","last_change":"2024-01-27T14:00:30.363756+0000","last_active":"2024-01-27T14:00:30.363735+0000","last_peered":"2024-01-27T14:00:30.363735+0000","last_clean":"2024-01-27T14:00:30.363735+0000","last_became_active":"2024-01-27T13:32:13.638676+0000","last_became_peered":"2024-01-27T13:32:13.638676+0000","last_unstale":"2024-01-27T14:00:30.363735+0000","last_undegraded":"2024-01-27T14:00:30.363735+0000","last_fullsized":"2024-01-27T14:00:30.363735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'37","last_scrub_stamp":"2024-01-27T14:00:30.363671+0000","last_deep_scrub":"27'37","last_deep_scrub_stamp":"2024-01-27T14:00:30.363671+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.363671+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:20:47.950019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"27'27","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:23.306194+0000","last_change":"2024-01-27T14:00:23.306215+0000","last_active":"2024-01-27T14:00:23.306194+0000","last_peered":"2024-01-27T14:00:23.306194+0000","last_clean":"2024-01-27T14:00:23.306194+0000","last_became_active":"2024-01-27T13:32:13.640244+0000","last_became_peered":"2024-01-27T13:32:13.640244+0000","last_unstale":"2024-01-27T14:00:23.306194+0000","last_undegraded":"2024-01-27T14:00:23.306194+0000","last_fullsized":"2024-01-27T14:00:23.306194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-01-27T14:00:23.306126+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-01-27T14:00:23.306126+0000","last_clean_scrub_stamp":"2024-01-27T14:00:23.306126+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T16:22:59.131177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:26.688163+0000","last_change":"2024-01-27T14:00:26.688214+0000","last_active":"2024-01-27T14:00:26.688163+0000","last_peered":"2024-01-27T14:00:26.688163+0000","last_clean":"2024-01-27T14:00:26.688163+0000","last_became_active":"2024-01-27T13:32:13.632623+0000","last_became_peered":"2024-01-27T13:32:13.632623+0000","last_unstale":"2024-01-27T14:00:26.688163+0000","last_undegraded":"2024-01-27T14:00:26.688163+0000","last_fullsized":"2024-01-27T14:00:26.688163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:26.688063+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:26.688063+0000","last_clean_scrub_stamp":"2024-01-27T14:00:26.688063+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T20:10:01.517967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"27'44","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.754530+0000","last_change":"2024-01-27T14:00:29.754551+0000","last_active":"2024-01-27T14:00:29.754530+0000","last_peered":"2024-01-27T14:00:29.754530+0000","last_clean":"2024-01-27T14:00:29.754530+0000","last_became_active":"2024-01-27T13:32:13.636201+0000","last_became_peered":"2024-01-27T13:32:13.636201+0000","last_unstale":"2024-01-27T14:00:29.754530+0000","last_undegraded":"2024-01-27T14:00:29.754530+0000","last_fullsized":"2024-01-27T14:00:29.754530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'44","last_scrub_stamp":"2024-01-27T14:00:29.754474+0000","last_deep_scrub":"27'44","last_deep_scrub_stamp":"2024-01-27T14:00:29.754474+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.754474+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:07:28.458461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"27'40","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:25.226587+0000","last_change":"2024-01-27T14:00:25.226608+0000","last_active":"2024-01-27T14:00:25.226587+0000","last_peered":"2024-01-27T14:00:25.226587+0000","last_clean":"2024-01-27T14:00:25.226587+0000","last_became_active":"2024-01-27T13:32:51.706260+0000","last_became_peered":"2024-01-27T13:32:51.706260+0000","last_unstale":"2024-01-27T14:00:25.226587+0000","last_undegraded":"2024-01-27T14:00:25.226587+0000","last_fullsized":"2024-01-27T14:00:25.226587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-01-27T14:00:25.226526+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-01-27T14:00:25.226526+0000","last_clean_scrub_stamp":"2024-01-27T14:00:25.226526+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:18:29.216625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"27'30","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.346013+0000","last_change":"2024-01-27T14:00:29.346036+0000","last_active":"2024-01-27T14:00:29.346013+0000","last_peered":"2024-01-27T14:00:29.346013+0000","last_clean":"2024-01-27T14:00:29.346013+0000","last_became_active":"2024-01-27T13:32:13.636751+0000","last_became_peered":"2024-01-27T13:32:13.636751+0000","last_unstale":"2024-01-27T14:00:29.346013+0000","last_undegraded":"2024-01-27T14:00:29.346013+0000","last_fullsized":"2024-01-27T14:00:29.346013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-01-27T14:00:29.345945+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-01-27T14:00:29.345945+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.345945+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:24:13.029959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:29.610052+0000","last_change":"2024-01-27T14:00:29.610077+0000","last_active":"2024-01-27T14:00:29.610052+0000","last_peered":"2024-01-27T14:00:29.610052+0000","last_clean":"2024-01-27T14:00:29.610052+0000","last_became_active":"2024-01-27T13:32:13.600918+0000","last_became_peered":"2024-01-27T13:32:13.600918+0000","last_unstale":"2024-01-27T14:00:29.610052+0000","last_undegraded":"2024-01-27T14:00:29.610052+0000","last_fullsized":"2024-01-27T14:00:29.610052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'33","last_scrub_stamp":"2024-01-27T14:00:29.609980+0000","last_deep_scrub":"27'33","last_deep_scrub_stamp":"2024-01-27T14:00:29.609980+0000","last_clean_scrub_stamp":"2024-01-27T14:00:29.609980+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T01:21:14.742305+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"27'34","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:28.027878+0000","last_change":"2024-01-27T14:00:28.027901+0000","last_active":"2024-01-27T14:00:28.027878+0000","last_peered":"2024-01-27T14:00:28.027878+0000","last_clean":"2024-01-27T14:00:28.027878+0000","last_became_active":"2024-01-27T13:32:13.601331+0000","last_became_peered":"2024-01-27T13:32:13.601331+0000","last_unstale":"2024-01-27T14:00:28.027878+0000","last_undegraded":"2024-01-27T14:00:28.027878+0000","last_fullsized":"2024-01-27T14:00:28.027878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-01-27T14:00:28.027794+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-01-27T14:00:28.027794+0000","last_clean_scrub_stamp":"2024-01-27T14:00:28.027794+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:58:28.018377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"27'28","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:30.590263+0000","last_change":"2024-01-27T14:00:30.590315+0000","last_active":"2024-01-27T14:00:30.590263+0000","last_peered":"2024-01-27T14:00:30.590263+0000","last_clean":"2024-01-27T14:00:30.590263+0000","last_became_active":"2024-01-27T13:32:13.602301+0000","last_became_peered":"2024-01-27T13:32:13.602301+0000","last_unstale":"2024-01-27T14:00:30.590263+0000","last_undegraded":"2024-01-27T14:00:30.590263+0000","last_fullsized":"2024-01-27T14:00:30.590263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-01-27T14:00:30.590185+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-01-27T14:00:30.590185+0000","last_clean_scrub_stamp":"2024-01-27T14:00:30.590185+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T14:53:58.106344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"27'25","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:32.063170+0000","last_change":"2024-01-27T14:00:32.063194+0000","last_active":"2024-01-27T14:00:32.063170+0000","last_peered":"2024-01-27T14:00:32.063170+0000","last_clean":"2024-01-27T14:00:32.063170+0000","last_became_active":"2024-01-27T13:32:13.637386+0000","last_became_peered":"2024-01-27T13:32:13.637386+0000","last_unstale":"2024-01-27T14:00:32.063170+0000","last_undegraded":"2024-01-27T14:00:32.063170+0000","last_fullsized":"2024-01-27T14:00:32.063170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-01-27T14:00:32.063061+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-01-27T14:00:32.063061+0000","last_clean_scrub_stamp":"2024-01-27T14:00:32.063061+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:23:11.921482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"27'39","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:18.608207+0000","last_change":"2024-01-27T14:00:18.608243+0000","last_active":"2024-01-27T14:00:18.608207+0000","last_peered":"2024-01-27T14:00:18.608207+0000","last_clean":"2024-01-27T14:00:18.608207+0000","last_became_active":"2024-01-27T13:32:13.520040+0000","last_became_peered":"2024-01-27T13:32:13.520040+0000","last_unstale":"2024-01-27T14:00:18.608207+0000","last_undegraded":"2024-01-27T14:00:18.608207+0000","last_fullsized":"2024-01-27T14:00:18.608207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-01-27T14:00:18.608138+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-01-27T14:00:18.608138+0000","last_clean_scrub_stamp":"2024-01-27T14:00:18.608138+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-29T00:14:31.412106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"27'32","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:16.492666+0000","last_change":"2024-01-27T14:00:16.492686+0000","last_active":"2024-01-27T14:00:16.492666+0000","last_peered":"2024-01-27T14:00:16.492666+0000","last_clean":"2024-01-27T14:00:16.492666+0000","last_became_active":"2024-01-27T13:32:13.532509+0000","last_became_peered":"2024-01-27T13:32:13.532509+0000","last_unstale":"2024-01-27T14:00:16.492666+0000","last_undegraded":"2024-01-27T14:00:16.492666+0000","last_fullsized":"2024-01-27T14:00:16.492666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'32","last_scrub_stamp":"2024-01-27T14:00:16.492602+0000","last_deep_scrub":"27'32","last_deep_scrub_stamp":"2024-01-27T14:00:16.492602+0000","last_clean_scrub_stamp":"2024-01-27T14:00:16.492602+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T19:18:20.482701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"27'28","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-27T14:00:31.566282+0000","last_change":"2024-01-27T14:00:31.566321+0000","last_active":"2024-01-27T14:00:31.566282+0000","last_peered":"2024-01-27T14:00:31.566282+0000","last_clean":"2024-01-27T14:00:31.566282+0000","last_became_active":"2024-01-27T13:32:13.630918+0000","last_became_peered":"2024-01-27T13:32:13.630918+0000","last_unstale":"2024-01-27T14:00:31.566282+0000","last_undegraded":"2024-01-27T14:00:31.566282+0000","last_fullsized":"2024-01-27T14:00:31.566282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-01-27T14:00:31.566189+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-01-27T14:00:31.566189+0000","last_clean_scrub_stamp":"2024-01-27T14:00:31.566189+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-28T23:53:19.442042+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3814,"num_write_kb":297749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4253,"ondisk_log_size":4253,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2213,"ondisk_log_size":2213,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37841560,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":891,"num_read_kb":943,"num_write":8392,"num_write_kb":41932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51707904,"data_stored":75683120,"data_compressed":6983726,"data_compressed_allocated":10756096,"data_compressed_original":34791424,"omap_allocated":0,"internal_metadata":0},"log_size":7972,"ondisk_log_size":7972,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65166,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509788,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58756,"kb_used_data":9532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313084,"statfs":{"total":96636764160,"available":96576598016,"internally_reserved":0,"allocated":9760768,"data_stored":12897988,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.21199999999999999,"5min":0.189,"15min":0.189},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.19600000000000001},"max":{"1min":0.439,"5min":0.48499999999999999,"15min":0.62},"last":0.495}]},{"osd":1,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.34399999999999997,"15min":0.33700000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.316},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35799999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.23499999999999999},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.373,"15min":0.36699999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.38700000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.48799999999999999,"5min":0.56799999999999995,"15min":0.622},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.28000000000000003},"max":{"1min":0.73299999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39000000000000001,"5min":0.317,"15min":0.30099999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.38800000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.38900000000000001,"5min":0.38300000000000001,"15min":0.36399999999999999},"max":{"1min":0.65300000000000002,"5min":0.82399999999999995,"15min":0.879},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65500000000000003,"5min":0.873,"15min":0.873},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.36199999999999999},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.623}]},{"osd":7,"last update":"Sat Jan 27 13:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57199999999999995,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.69599999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.55100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.75700000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.75}]}]},{"osd":2,"up_from":15,"seq":64424509788,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":483328,"data_stored":314404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.29799999999999999,"15min":0.30599999999999999},"min":{"1min":0.216,"5min":0.19800000000000001,"15min":0.19600000000000001},"max":{"1min":0.42799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.316,"15min":0.31900000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.442,"5min":0.497,"15min":0.61699999999999999},"last":0.221}]},{"osd":1,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.22500000000000001},"max":{"1min":0.45300000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.36399999999999999,"15min":0.35399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.46899999999999997,"5min":0.60399999999999998,"15min":0.63},"last":0.36199999999999999}]},{"osd":3,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.223,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.59699999999999998},"last":0.316},{"interface":"front","average":{"1min":0.376,"5min":0.38600000000000001,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.26300000000000001,"15min":0.224},"max":{"1min":0.46300000000000002,"5min":0.61499999999999999,"15min":0.79500000000000004},"last":0.40300000000000002}]},{"osd":4,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.29699999999999999},"max":{"1min":0.57799999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.82399999999999995},"last":0.46800000000000003}]},{"osd":5,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.34499999999999997},"max":{"1min":0.67600000000000005,"5min":0.71699999999999997,"15min":0.79100000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.434}]},{"osd":6,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.36499999999999999,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.874},"last":0.495},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42099999999999999,"5min":0.38600000000000001,"15min":0.38500000000000001},"max":{"1min":0.751,"5min":0.83199999999999996,"15min":0.88100000000000001},"last":0.503}]},{"osd":7,"last update":"Sat Jan 27 13:59:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.56299999999999994},"min":{"1min":0.43099999999999999,"5min":0.373,"15min":0.36499999999999999},"max":{"1min":0.75600000000000001,"5min":0.79300000000000004,"15min":0.84899999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.45100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81000000000000005},"last":0.44800000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509788,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42148,"kb_used_data":2652,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329692,"statfs":{"total":96636764160,"available":96593604608,"internally_reserved":0,"allocated":2715648,"data_stored":4203962,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.317,"15min":0.314},"min":{"1min":0.191,"5min":0.191,"15min":0.19},"max":{"1min":0.46500000000000002,"5min":0.47899999999999998,"15min":0.51400000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.20899999999999999},"max":{"1min":0.42499999999999999,"5min":0.54400000000000004,"15min":0.63200000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.317,"15min":0.318},"min":{"1min":0.221,"5min":0.188,"15min":0.188},"max":{"1min":0.45100000000000001,"5min":0.50800000000000001,"15min":0.72899999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.36199999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.41999999999999998,"5min":0.51700000000000002,"15min":0.622},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.375,"15min":0.379},"min":{"1min":0.25,"5min":0.247,"15min":0.247},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.63500000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53900000000000003,"5min":0.55700000000000005,"15min":1.0149999999999999},"last":0.625}]},{"osd":4,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.27200000000000002},"max":{"1min":0.73399999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.29899999999999999},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":0.86899999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.38500000000000001,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.78100000000000003}]},{"osd":6,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.34599999999999997},"max":{"1min":0.66300000000000003,"5min":0.84299999999999997,"15min":0.871},"last":0.748},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.71399999999999997,"5min":1,"15min":1},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Jan 27 13:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72999999999999998,"5min":0.81100000000000005,"15min":0.83799999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80100000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542492,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61656,"kb_used_data":16592,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94310184,"statfs":{"total":96636764160,"available":96573628416,"internally_reserved":0,"allocated":16990208,"data_stored":25766272,"data_compressed":2458257,"data_compressed_allocated":3723264,"data_compressed_original":12673024,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.27100000000000002,"15min":0.25900000000000001},"max":{"1min":0.58199999999999996,"5min":0.60099999999999998,"15min":0.69999999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.309},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.72999999999999998},"last":0.54800000000000004}]},{"osd":1,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45600000000000002,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.71599999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.42999999999999999,"15min":0.437},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.25800000000000001},"max":{"1min":0.55600000000000005,"5min":0.59199999999999997,"15min":0.68500000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44700000000000001,"15min":0.45800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.23899999999999999},"max":{"1min":0.56100000000000005,"5min":0.63700000000000001,"15min":0.70199999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48299999999999998},"min":{"1min":0.36799999999999999,"5min":0.31900000000000001,"15min":0.29899999999999999},"max":{"1min":0.67000000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.59499999999999997}]},{"osd":3,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.29399999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.71799999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77800000000000002},"last":0.49299999999999999}]},{"osd":4,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.28899999999999998,"5min":0.26800000000000002,"15min":0.19900000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.81299999999999994},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.29599999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.34100000000000003,"5min":0.30299999999999999,"15min":0.26400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.28199999999999997,"15min":0.23300000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.85099999999999998},"last":0.628}]},{"osd":6,"last update":"Sat Jan 27 13:59:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.26000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.82699999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.46800000000000003,"5min":0.32200000000000001,"15min":0.28799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60499999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542492,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73384,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94298456,"statfs":{"total":96636764160,"available":96561618944,"internally_reserved":0,"allocated":11960320,"data_stored":16894162,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":1594,"internal_metadata":63175110},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.438,"15min":0.433},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.22900000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.84099999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.46300000000000002,"15min":0.46000000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.72399999999999998},"last":0.53900000000000003}]},{"osd":1,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.873},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.33600000000000002,"5min":0.317,"15min":0.25600000000000001},"max":{"1min":0.58299999999999996,"5min":0.65700000000000003,"15min":0.68200000000000005},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":0.58699999999999997,"5min":0.66900000000000004,"15min":0.80200000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66900000000000004,"5min":0.68100000000000005,"15min":0.89300000000000002},"last":0.52800000000000002}]},{"osd":3,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.46600000000000003,"15min":0.47299999999999998},"min":{"1min":0.35699999999999998,"5min":0.315,"15min":0.29099999999999998},"max":{"1min":0.59999999999999998,"5min":0.75600000000000001,"15min":0.76600000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28799999999999998},"max":{"1min":0.627,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.41299999999999998}]},{"osd":4,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.249,"15min":0.22600000000000001},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.91400000000000003},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.22700000000000001},"max":{"1min":0.65300000000000002,"5min":0.70999999999999996,"15min":0.83899999999999997},"last":0.42199999999999999}]},{"osd":5,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.27100000000000002},"max":{"1min":0.61899999999999999,"5min":0.68700000000000006,"15min":0.83599999999999997},"last":0.379},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":0.66000000000000003,"5min":0.78800000000000003,"15min":0.93500000000000005},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Jan 27 13:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.32100000000000001,"5min":0.29999999999999999,"15min":0.25900000000000001},"max":{"1min":0.65200000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.52900000000000003,"15min":0.53400000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.29299999999999998},"max":{"1min":0.65000000000000002,"5min":0.81899999999999995,"15min":0.89500000000000002},"last":0.496}]}]},{"osd":5,"up_from":14,"seq":60129542491,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":116364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.46000000000000002,"15min":0.434},"min":{"1min":0.309,"5min":0.27900000000000003,"15min":0.20100000000000001},"max":{"1min":0.62,"5min":0.66400000000000003,"15min":0.67300000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.28399999999999997,"5min":0.23999999999999999,"15min":0.23799999999999999},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":0.74399999999999999}]},{"osd":1,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.441},"min":{"1min":0.30599999999999999,"5min":0.25,"15min":0.247},"max":{"1min":0.64500000000000002,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46700000000000003,"15min":0.47399999999999998},"min":{"1min":0.38400000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57499999999999996,"5min":0.66300000000000003,"15min":0.76300000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.44400000000000001},"min":{"1min":0.33900000000000002,"5min":0.32200000000000001,"15min":0.28399999999999997},"max":{"1min":0.64100000000000001,"5min":1.101,"15min":1.101},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70799999999999996},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Jan 27 13:59:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.35499999999999998,"5min":0.30399999999999999,"15min":0.29699999999999999},"max":{"1min":0.64900000000000002,"5min":0.70099999999999996,"15min":0.71599999999999997},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.39100000000000001,"5min":0.34499999999999997,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.46000000000000002},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.245},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.505,"15min":0.49199999999999999},"min":{"1min":0.28699999999999998,"5min":0.27200000000000002,"15min":0.23999999999999999},"max":{"1min":0.72399999999999998,"5min":0.73099999999999998,"15min":0.76300000000000001},"last":0.442}]},{"osd":6,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.48599999999999999,"15min":0.48299999999999998},"min":{"1min":0.29399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.74199999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.502},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68999999999999995,"5min":0.754,"15min":0.76300000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Sat Jan 27 13:59:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.52900000000000003},"min":{"1min":0.35699999999999998,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.79100000000000004},"last":0.47899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542492,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41272,"kb_used_data":5936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330568,"statfs":{"total":96636764160,"available":96594501632,"internally_reserved":0,"allocated":6078464,"data_stored":8505008,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.72099999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.45000000000000001},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.20699999999999999},"max":{"1min":0.65200000000000002,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47899999999999998}]},{"osd":1,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66700000000000004},"last":0.433},{"interface":"front","average":{"1min":0.438,"5min":0.45600000000000002,"15min":0.45300000000000001},"min":{"1min":0.33400000000000002,"5min":0.32400000000000001,"15min":0.222},"max":{"1min":0.63500000000000001,"5min":0.66600000000000004,"15min":0.83599999999999997},"last":0.495}]},{"osd":2,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.46500000000000002},"min":{"1min":0.38400000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45400000000000001,"15min":0.45200000000000001},"min":{"1min":0.33700000000000002,"5min":0.28199999999999997,"15min":0.26800000000000002},"max":{"1min":0.56200000000000006,"5min":0.68000000000000005,"15min":0.872},"last":0.38200000000000001}]},{"osd":3,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.502,"15min":0.498},"min":{"1min":0.36499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.78900000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.32700000000000001},"max":{"1min":0.65600000000000003,"5min":0.66500000000000004,"15min":0.80900000000000005},"last":0.54900000000000004}]},{"osd":5,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47299999999999998,"15min":0.46600000000000003},"min":{"1min":0.315,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.65600000000000003,"5min":0.748,"15min":0.748},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.26300000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66600000000000004,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.32400000000000001}]},{"osd":6,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.48099999999999998},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.85599999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39800000000000002}]},{"osd":7,"last update":"Sat Jan 27 13:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.29399999999999998},"max":{"1min":0.71899999999999997,"5min":0.75700000000000001,"15min":0.76400000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.69899999999999995,"5min":0.754,"15min":0.877},"last":0.52600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575196,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41024,"kb_used_data":5688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330816,"statfs":{"total":96636764160,"available":96594755584,"internally_reserved":0,"allocated":5824512,"data_stored":9095888,"data_compressed":837553,"data_compressed_allocated":1253376,"data_compressed_original":4706304,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.216,"5min":0.188,"15min":0.17899999999999999},"max":{"1min":0.41299999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.313},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.308},"min":{"1min":0.217,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.437,"5min":0.52600000000000002,"15min":0.59799999999999998},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.36099999999999999,"15min":0.35399999999999998},"min":{"1min":0.27300000000000002,"5min":0.222,"15min":0.19500000000000001},"max":{"1min":0.502,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.35799999999999998,"15min":0.35099999999999998},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54600000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34699999999999998}]},{"osd":3,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.34999999999999998},"min":{"1min":0.252,"5min":0.246,"15min":0.20999999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.63600000000000001},"last":0.498},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.39100000000000001,"15min":0.38700000000000001},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.23200000000000001},"max":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.78600000000000003},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.33600000000000002,"15min":0.27800000000000002},"max":{"1min":0.69399999999999995,"5min":0.754,"15min":0.91600000000000004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.504,"15min":0.51300000000000001},"min":{"1min":0.377,"5min":0.317,"15min":0.28499999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.76500000000000001},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.36499999999999999,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.81499999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.33400000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.79300000000000004},"last":0.54900000000000004}]},{"osd":6,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54900000000000004,"15min":0.55000000000000004},"min":{"1min":0.36199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71999999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.38200000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.53600000000000003}]},{"osd":7,"last update":"Sat Jan 27 13:59:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.38300000000000001,"5min":0.36799999999999999,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.35699999999999998,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32583,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":8389246,"data_compressed":804970,"data_compressed_allocated":1208320,"data_compressed_original":4132864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2433024,"data_stored":4087688,"data_compressed":506205,"data_compressed_allocated":724992,"data_compressed_original":2387968,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":198130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9478144,"data_stored":12781714,"data_compressed":994211,"data_compressed_allocated":1622016,"data_compressed_original":4935680,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5795840,"data_stored":8388734,"data_compressed":804177,"data_compressed_allocated":1261568,"data_compressed_original":3866624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11677696,"data_stored":16777888,"data_compressed":1448489,"data_compressed_allocated":2260992,"data_compressed_original":7368704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16642048,"data_stored":25059630,"data_compressed":2425674,"data_compressed_allocated":3678208,"data_compressed_original":12099584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-27T14:00:42.420 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-27T14:00:42.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.566+0000 7f4093a46640 1 Processor -- start 2024-01-27T14:00:42.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.567+0000 7f4093a46640 1 -- start start 2024-01-27T14:00:42.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.567+0000 7f4093a46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f408c0c4ba0 0x7f408c0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:42.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.567+0000 7f4093a46640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c06bcd0 con 0x7f408c0c4f80 2024-01-27T14:00:42.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.567+0000 7f4093a46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c06bf40 con 0x7f408c153e70 2024-01-27T14:00:42.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.568+0000 7f4093a46640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c06cd00 con 0x7f408c0c4ba0 2024-01-27T14:00:42.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.568+0000 7f4090fe1640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f408c0c4f80 0x7f408c153760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39238/0 (socket says 172.21.15.46:39238) 2024-01-27T14:00:42.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.568+0000 7f4090fe1640 1 -- 172.21.15.46:0/3023747983 learned_addr learned my addr 172.21.15.46:0/3023747983 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:42.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.568+0000 7f40917e2640 1 --2- 172.21.15.46:0/3023747983 >> v2:172.21.15.78:3300/0 conn(0x7f408c0c4ba0 0x7f408c0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:42.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.571+0000 7f408bfff640 1 -- 172.21.15.46:0/3023747983 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432937528 0 0) 0x7f408c06bcd0 con 0x7f408c0c4f80 2024-01-27T14:00:42.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.571+0000 7f408bfff640 1 -- 172.21.15.46:0/3023747983 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4074003520 con 0x7f408c0c4f80 2024-01-27T14:00:42.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.571+0000 7f40917e2640 1 -- 172.21.15.46:0/3023747983 >> v1:172.21.15.78:6789/0 conn(0x7f408c153e70 legacy=0x7f408c164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.571+0000 7f40917e2640 1 -- 172.21.15.46:0/3023747983 >> v1:172.21.15.46:6789/0 conn(0x7f408c0c4f80 legacy=0x7f408c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.571+0000 7f40917e2640 1 -- 172.21.15.46:0/3023747983 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c06c220 con 0x7f408c0c4ba0 2024-01-27T14:00:42.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.577+0000 7f40917e2640 1 --2- 172.21.15.46:0/3023747983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4ba0 0x7f408c0b2670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40840097a0 tx=0x7f408402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2136f8473af0bee4 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:42.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.580+0000 7f408bfff640 1 -- 172.21.15.46:0/3023747983 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408402f810 con 0x7f408c0c4ba0 2024-01-27T14:00:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.580+0000 7f408bfff640 1 -- 172.21.15.46:0/3023747983 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408402f970 con 0x7f408c0c4ba0 2024-01-27T14:00:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.580+0000 7f408bfff640 1 -- 172.21.15.46:0/3023747983 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408402fd00 con 0x7f408c0c4ba0 2024-01-27T14:00:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 -- 172.21.15.46:0/3023747983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4ba0 msgr2=0x7f408c0b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 --2- 172.21.15.46:0/3023747983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4ba0 0x7f408c0b2670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f40840097a0 tx=0x7f408402b9f0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 -- 172.21.15.46:0/3023747983 shutdown_connections 2024-01-27T14:00:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 --2- 172.21.15.46:0/3023747983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4ba0 0x7f408c0b2670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 -- 172.21.15.46:0/3023747983 >> 172.21.15.46:0/3023747983 conn(0x7f408c08b6b0 msgr2=0x7f408c0663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 -- 172.21.15.46:0/3023747983 shutdown_connections 2024-01-27T14:00:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.581+0000 7f4093a46640 1 -- 172.21.15.46:0/3023747983 wait complete. 2024-01-27T14:00:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.582+0000 7f4093a46640 1 Processor -- start 2024-01-27T14:00:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.582+0000 7f4093a46640 1 -- start start 2024-01-27T14:00:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f4093a46640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 0x7f408c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f4093a46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4f80 0x7f408c149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f4093a46640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f408c153e70 0x7f408c149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f4093a46640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c154620 con 0x7f408c0c4ba0 2024-01-27T14:00:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f4093a46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c6e10 con 0x7f408c0c4f80 2024-01-27T14:00:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f4093a46640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0c6890 con 0x7f408c153e70 2024-01-27T14:00:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.583+0000 7f40917e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 0x7f408c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.584+0000 7f40917e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 0x7f408c155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38440/0 (socket says 172.21.15.46:38440) 2024-01-27T14:00:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.584+0000 7f40917e2640 1 -- 172.21.15.46:0/1163979648 learned_addr learned my addr 172.21.15.46:0/1163979648 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.584+0000 7f4090fe1640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4f80 0x7f408c149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.584+0000 7f4091fe3640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f408c153e70 0x7f408c149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.587+0000 7f40917e2640 1 -- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f408c153e70 msgr2=0x7f408c149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.587+0000 7f40917e2640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f408c153e70 0x7f408c149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.587+0000 7f40917e2640 1 -- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4f80 msgr2=0x7f408c149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.587+0000 7f40917e2640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4f80 0x7f408c149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.587+0000 7f40917e2640 1 -- 172.21.15.46:0/1163979648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4084009400 con 0x7f408c0c4ba0 2024-01-27T14:00:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.587+0000 7f4090fe1640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4f80 0x7f408c149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:00:42.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.590+0000 7f40917e2640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 0x7f408c155bb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f408402c000 tx=0x7f40840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:42.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.594+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408403b040 con 0x7f408c0c4ba0 2024-01-27T14:00:42.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.594+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40840378d0 con 0x7f408c0c4ba0 2024-01-27T14:00:42.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.594+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084037c80 con 0x7f408c0c4ba0 2024-01-27T14:00:42.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.594+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c1f0100 con 0x7f408c0c4ba0 2024-01-27T14:00:42.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.594+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c1560f0 con 0x7f408c0c4ba0 2024-01-27T14:00:42.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.595+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c074410 con 0x7f408c0c4ba0 2024-01-27T14:00:42.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.615+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4084042460 con 0x7f408c0c4ba0 2024-01-27T14:00:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.615+0000 7f4089ffb640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f407806aed0 0x7f407806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.616+0000 7f4090fe1640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f407806aed0 0x7f407806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:42.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.616+0000 7f4090fe1640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f407806aed0 0x7f407806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f408c1ed110 tx=0x7f4080009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:42.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.619+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f408407ad90 con 0x7f408c0c4ba0 2024-01-27T14:00:42.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:42.870+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f40840770d0 con 0x7f408c0c4ba0 2024-01-27T14:00:43.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.052+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f408c150e50 con 0x7f408c0c4ba0 2024-01-27T14:00:43.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.147+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4084050020 con 0x7f408c0c4ba0 2024-01-27T14:00:43.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.147+0000 7f4089ffb640 1 -- 172.21.15.46:0/1163979648 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f40840770d0 con 0x7f408c0c4ba0 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f407806aed0 msgr2=0x7f407806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f407806aed0 0x7f407806d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f408c1ed110 tx=0x7f4080009040 comp rx=0 tx=0).stop 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 msgr2=0x7f408c155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 0x7f408c155bb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f408402c000 tx=0x7f40840046c0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 shutdown_connections 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f407806aed0 0x7f407806d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f408c153e70 0x7f408c149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.149+0000 7f4093a46640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f408c0c4f80 0x7f408c149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.150+0000 7f4093a46640 1 --2- 172.21.15.46:0/1163979648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f408c0c4ba0 0x7f408c155bb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.150+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 >> 172.21.15.46:0/1163979648 conn(0x7f408c08b6b0 msgr2=0x7f408c151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.150+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 shutdown_connections 2024-01-27T14:00:43.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.150+0000 7f4093a46640 1 -- 172.21.15.46:0/1163979648 wait complete. 2024-01-27T14:00:43.147 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-27T14:00:43.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:00:43.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.273+0000 7fc3b91d0640 1 Processor -- start 2024-01-27T14:00:43.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.273+0000 7fc3b91d0640 1 -- start start 2024-01-27T14:00:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.274+0000 7fc3b91d0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc3b40c28c0 0x7fc3b40c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.274+0000 7fc3b91d0640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7fc3b4151c00 0x7fc3b4157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.274+0000 7fc3b91d0640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b40ccf60 con 0x7fc3b40c2ca0 2024-01-27T14:00:43.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.274+0000 7fc3b91d0640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40ca800 con 0x7fc3b4151c00 2024-01-27T14:00:43.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.274+0000 7fc3b91d0640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b41576d0 con 0x7fc3b40c28c0 2024-01-27T14:00:43.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.298+0000 7fc3b2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc3b40c28c0 0x7fc3b40c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.298+0000 7fc3b2d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc3b40c28c0 0x7fc3b40c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:36366/0 (socket says 172.21.15.46:36366) 2024-01-27T14:00:43.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.298+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1551872411 learned_addr learned my addr 172.21.15.46:0/1551872411 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.300+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1551872411 >> v2:172.21.15.46:3300/0 conn(0x7fc3b4151c00 msgr2=0x7fc3b4157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.300+0000 7fc3b2d9d640 1 --2- 172.21.15.46:0/1551872411 >> v2:172.21.15.46:3300/0 conn(0x7fc3b4151c00 0x7fc3b4157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.300+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1551872411 >> v1:172.21.15.46:6789/0 conn(0x7fc3b40c2ca0 legacy=0x7fc3b41514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.300+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1551872411 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b40cd200 con 0x7fc3b40c28c0 2024-01-27T14:00:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.302+0000 7fc3b2d9d640 1 --2- 172.21.15.46:0/1551872411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b40c1cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40718d0 tx=0x7fc3a402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cffce66209022429 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.304+0000 7fc3b259c640 1 -- 172.21.15.46:0/1551872411 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4031870 con 0x7fc3b40c28c0 2024-01-27T14:00:43.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b259c640 1 -- 172.21.15.46:0/1551872411 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3a40319d0 con 0x7fc3b40c28c0 2024-01-27T14:00:43.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b259c640 1 -- 172.21.15.46:0/1551872411 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4031d80 con 0x7fc3b40c28c0 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1551872411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 msgr2=0x7fc3b40c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1551872411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b40c1cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40718d0 tx=0x7fc3a402b910 comp rx=0 tx=0).stop 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1551872411 shutdown_connections 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1551872411 >> v2:172.21.15.46:3300/0 conn(0x7fc3b4151c00 0x7fc3b4157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1551872411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b40c1cd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1551872411 >> 172.21.15.46:0/1551872411 conn(0x7fc3b406efe0 msgr2=0x7fc3b406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1551872411 shutdown_connections 2024-01-27T14:00:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.307+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1551872411 wait complete. 2024-01-27T14:00:43.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 Processor -- start 2024-01-27T14:00:43.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 -- start start 2024-01-27T14:00:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b41dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3b40c2ca0 0x7fc3b4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b4151c00 0x7fc3b41ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4151fe0 con 0x7fc3b4151c00 2024-01-27T14:00:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b41ece10 con 0x7fc3b40c28c0 2024-01-27T14:00:43.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.309+0000 7fc3b91d0640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4153d90 con 0x7fc3b40c2ca0 2024-01-27T14:00:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.310+0000 7fc3b2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b41dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.310+0000 7fc3abfff640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3b40c2ca0 0x7fc3b4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.310+0000 7fc3b2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b41dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:36368/0 (socket says 172.21.15.46:36368) 2024-01-27T14:00:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.310+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1305728874 learned_addr learned my addr 172.21.15.46:0/1305728874 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:43.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.310+0000 7fc3b359e640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b4151c00 0x7fc3b41ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.314+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3b40c2ca0 msgr2=0x7fc3b4156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.314+0000 7fc3b2d9d640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3b40c2ca0 0x7fc3b4156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.314+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b4151c00 msgr2=0x7fc3b41ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.314+0000 7fc3b2d9d640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b4151c00 0x7fc3b41ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.314+0000 7fc3b2d9d640 1 -- 172.21.15.46:0/1305728874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40094d0 con 0x7fc3b40c28c0 2024-01-27T14:00:43.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.316+0000 7fc3b2d9d640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b41dd7b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc3a402b950 tx=0x7fc3a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:43.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.320+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40443f0 con 0x7fc3b40c28c0 2024-01-27T14:00:43.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.320+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc3a4044550 con 0x7fc3b40c28c0 2024-01-27T14:00:43.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.320+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4044920 con 0x7fc3b40c28c0 2024-01-27T14:00:43.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.320+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b4154030 con 0x7fc3b40c28c0 2024-01-27T14:00:43.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.320+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b41545f0 con 0x7fc3b40c28c0 2024-01-27T14:00:43.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.321+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b4074410 con 0x7fc3b40c28c0 2024-01-27T14:00:43.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.339+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc3a404d450 con 0x7fc3b40c28c0 2024-01-27T14:00:43.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.340+0000 7fc3ab7fe640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39406af00 0x7fc39406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.340+0000 7fc3abfff640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39406af00 0x7fc39406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.340+0000 7fc3abfff640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39406af00 0x7fc39406d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40c71c0 tx=0x7fc39c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:43.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.565+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3a402d040 con 0x7fc3b40c28c0 2024-01-27T14:00:43.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.575+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc3a4077120 con 0x7fc3b40c28c0 2024-01-27T14:00:43.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.804+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3b40c9420 con 0x7fc3b40c28c0 2024-01-27T14:00:43.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.817+0000 7fc3ab7fe640 1 -- 172.21.15.46:0/1305728874 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6514 (secure 0 0 0) 0x7fc3a4035070 con 0x7fc3b40c28c0 2024-01-27T14:00:43.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:43.803 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:45.974762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T14:00:43.803 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-01-27T14:00:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39406af00 msgr2=0x7fc39406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39406af00 0x7fc39406d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3b40c71c0 tx=0x7fc39c009040 comp rx=0 tx=0).stop 2024-01-27T14:00:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 msgr2=0x7fc3b41dd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b41dd7b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc3a402b950 tx=0x7fc3a40046c0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 shutdown_connections 2024-01-27T14:00:43.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fc39406af00 0x7fc39406d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b4151c00 0x7fc3b41ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fc3b40c2ca0 0x7fc3b4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 --2- 172.21.15.46:0/1305728874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3b40c28c0 0x7fc3b41dd7b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 >> 172.21.15.46:0/1305728874 conn(0x7fc3b406efe0 msgr2=0x7fc3b40c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:43.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 shutdown_connections 2024-01-27T14:00:43.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.818+0000 7fc3b91d0640 1 -- 172.21.15.46:0/1305728874 wait complete. 2024-01-27T14:00:43.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-27T14:00:43.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.931+0000 7f29f34b6640 1 Processor -- start 2024-01-27T14:00:43.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.931+0000 7f29f34b6640 1 -- start start 2024-01-27T14:00:43.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.932+0000 7f29f34b6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29ec15d990 0x7f29ec06bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.932+0000 7f29f34b6640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29ec0c7d70 0x7f29ec06c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.932+0000 7f29f34b6640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec06c9a0 con 0x7f29ec06b820 2024-01-27T14:00:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.932+0000 7f29f34b6640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec06c140 con 0x7f29ec0c7d70 2024-01-27T14:00:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.932+0000 7f29f34b6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec15d500 con 0x7f29ec15d990 2024-01-27T14:00:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.932+0000 7f29f1a53640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f29ec0c7d70 0x7f29ec06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.933+0000 7f29f0a51640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f29ec15d990 0x7f29ec06bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.933+0000 7f29f1252640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f29ec06b820 0x7f29ec159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:39256/0 (socket says 172.21.15.46:39256) 2024-01-27T14:00:43.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.933+0000 7f29f1252640 1 -- 172.21.15.46:0/1784045393 learned_addr learned my addr 172.21.15.46:0/1784045393 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:43.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.935+0000 7f29f0a51640 1 -- 172.21.15.46:0/1784045393 >> v2:172.21.15.46:3300/0 conn(0x7f29ec0c7d70 msgr2=0x7f29ec06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:43.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.935+0000 7f29f0a51640 1 --2- 172.21.15.46:0/1784045393 >> v2:172.21.15.46:3300/0 conn(0x7f29ec0c7d70 0x7f29ec06c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.935+0000 7f29f0a51640 1 -- 172.21.15.46:0/1784045393 >> v1:172.21.15.46:6789/0 conn(0x7f29ec06b820 legacy=0x7f29ec159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.935+0000 7f29f0a51640 1 -- 172.21.15.46:0/1784045393 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0c7b50 con 0x7f29ec15d990 2024-01-27T14:00:43.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.937+0000 7f29f0a51640 1 --2- 172.21.15.46:0/1784045393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec15d990 0x7f29ec06bc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f29ec071e90 tx=0x7f29dc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b553601994499b0e server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:43.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.939+0000 7f29e3fff640 1 -- 172.21.15.46:0/1784045393 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc030610 con 0x7f29ec15d990 2024-01-27T14:00:43.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.940+0000 7f29e3fff640 1 -- 172.21.15.46:0/1784045393 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f29dc030770 con 0x7f29ec15d990 2024-01-27T14:00:43.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.940+0000 7f29e3fff640 1 -- 172.21.15.46:0/1784045393 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29dc030b20 con 0x7f29ec15d990 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 -- 172.21.15.46:0/1784045393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec15d990 msgr2=0x7f29ec06bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 --2- 172.21.15.46:0/1784045393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec15d990 0x7f29ec06bc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f29ec071e90 tx=0x7f29dc02b960 comp rx=0 tx=0).stop 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 -- 172.21.15.46:0/1784045393 shutdown_connections 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 --2- 172.21.15.46:0/1784045393 >> v2:172.21.15.46:3300/0 conn(0x7f29ec0c7d70 0x7f29ec06c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 --2- 172.21.15.46:0/1784045393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec15d990 0x7f29ec06bc00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 -- 172.21.15.46:0/1784045393 >> 172.21.15.46:0/1784045393 conn(0x7f29ec0663a0 msgr2=0x7f29ec0667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 -- 172.21.15.46:0/1784045393 shutdown_connections 2024-01-27T14:00:43.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.941+0000 7f29f34b6640 1 -- 172.21.15.46:0/1784045393 wait complete. 2024-01-27T14:00:43.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.942+0000 7f29f34b6640 1 Processor -- start 2024-01-27T14:00:43.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.942+0000 7f29f34b6640 1 -- start start 2024-01-27T14:00:43.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.943+0000 7f29f34b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec06b820 0x7f29ec0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.943+0000 7f29f34b6640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29ec0c7d70 0x7f29ec158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.943+0000 7f29f34b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 0x7f29ec158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.943+0000 7f29f34b6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec1f0110 con 0x7f29ec15d990 2024-01-27T14:00:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.943+0000 7f29f34b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0c9850 con 0x7f29ec06b820 2024-01-27T14:00:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.943+0000 7f29f34b6640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0c5fa0 con 0x7f29ec0c7d70 2024-01-27T14:00:43.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.944+0000 7f29f1a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 0x7f29ec158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.944+0000 7f29f1252640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec06b820 0x7f29ec0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.944+0000 7f29f0a51640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29ec0c7d70 0x7f29ec158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:43.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.944+0000 7f29f1a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 0x7f29ec158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38476/0 (socket says 172.21.15.46:38476) 2024-01-27T14:00:43.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.944+0000 7f29f1a53640 1 -- 172.21.15.46:0/976455982 learned_addr learned my addr 172.21.15.46:0/976455982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:43.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.947+0000 7f29f1a53640 1 -- 172.21.15.46:0/976455982 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29ec0c7d70 msgr2=0x7f29ec158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.947+0000 7f29f1a53640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29ec0c7d70 0x7f29ec158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.947+0000 7f29f1a53640 1 -- 172.21.15.46:0/976455982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec06b820 msgr2=0x7f29ec0c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:43.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.947+0000 7f29f1a53640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec06b820 0x7f29ec0c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:43.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.947+0000 7f29f1a53640 1 -- 172.21.15.46:0/976455982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc009400 con 0x7f29ec15d990 2024-01-27T14:00:43.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.950+0000 7f29f1a53640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 0x7f29ec158d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29e400efc0 tx=0x7f29e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:43.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.954+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4014480 con 0x7f29ec15d990 2024-01-27T14:00:43.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.954+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f29e400f040 con 0x7f29ec15d990 2024-01-27T14:00:43.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.954+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec1ef490 con 0x7f29ec15d990 2024-01-27T14:00:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.954+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4014840 con 0x7f29ec15d990 2024-01-27T14:00:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.954+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec1efa50 con 0x7f29ec15d990 2024-01-27T14:00:43.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:43.955+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec158550 con 0x7f29ec15d990 2024-01-27T14:00:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.218+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f29e40149a0 con 0x7f29ec15d990 2024-01-27T14:00:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.218+0000 7f29e1ffb640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f29d006af20 0x7f29d006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.219+0000 7f29f1252640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f29d006af20 0x7f29d006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:44.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.219+0000 7f29f1252640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f29d006af20 0x7f29d006d3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29e8000f60 tx=0x7f29e8007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.231+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f29e4059420 con 0x7f29ec15d990 2024-01-27T14:00:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.232+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f29e4055760 con 0x7f29ec15d990 2024-01-27T14:00:44.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.449+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29ec158550 con 0x7f29ec15d990 2024-01-27T14:00:44.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.462+0000 7f29e1ffb640 1 -- 172.21.15.46:0/976455982 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6514 (secure 0 0 0) 0x7f29ec158550 con 0x7f29ec15d990 2024-01-27T14:00:44.448 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:44.448 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2834453977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2834453977},{"type":"v1","addr":"172.21.15.78:6837","nonce":2834453977}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4227,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1811318167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1811318167},{"type":"v1","addr":"172.21.15.78:6833","nonce":1811318167}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/2819721877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":2819721877},{"type":"v1","addr":"172.21.15.46:6839","nonce":2819721877}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/655009614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":655009614},{"type":"v1","addr":"172.21.15.78:6836","nonce":655009614}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3813202255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3813202255},{"type":"v1","addr":"172.21.15.46:6835","nonce":3813202255}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-27T13:32:13.208332+0000","modified":"2024-01-27T13:32:45.974762+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.46:6837/3746495433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":3746495433},{"type":"v1","addr":"172.21.15.46:6837","nonce":3746495433}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-27T14:00:44.449 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-01-27T14:00:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f29d006af20 msgr2=0x7f29d006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f29d006af20 0x7f29d006d3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29e8000f60 tx=0x7f29e8007e80 comp rx=0 tx=0).stop 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 msgr2=0x7f29ec158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 0x7f29ec158d70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29e400efc0 tx=0x7f29e400c490 comp rx=0 tx=0).stop 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 shutdown_connections 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f29d006af20 0x7f29d006d3e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ec15d990 0x7f29ec158d70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f29ec0c7d70 0x7f29ec158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 --2- 172.21.15.46:0/976455982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29ec06b820 0x7f29ec0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 >> 172.21.15.46:0/976455982 conn(0x7f29ec0663a0 msgr2=0x7f29ec152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 shutdown_connections 2024-01-27T14:00:44.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.464+0000 7f29f34b6640 1 -- 172.21.15.46:0/976455982 wait complete. 2024-01-27T14:00:44.462 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-27T14:00:44.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.577+0000 7f7959fc5640 1 Processor -- start 2024-01-27T14:00:44.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.577+0000 7f7959fc5640 1 -- start start 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.578+0000 7f7959fc5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f795406b820 0x7f795406bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.578+0000 7f7959fc5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795415d500 con 0x7f795415d990 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.578+0000 7f7959fc5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79540c7b50 con 0x7f79540c7d70 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.578+0000 7f7959fc5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795406c140 con 0x7f795406b820 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.579+0000 7f7952ffd640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7f795415d990 0x7f7954159720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49082/0 (socket says 172.21.15.46:49082) 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.579+0000 7f7952ffd640 1 -- 172.21.15.46:0/1042718555 learned_addr learned my addr 172.21.15.46:0/1042718555 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:44.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.579+0000 7f79537fe640 1 --2- 172.21.15.46:0/1042718555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f795406b820 0x7f795406bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.581+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325887941 0 0) 0x7f795415d500 con 0x7f795415d990 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.581+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 --> v1:172.21.15.46:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c003520 con 0x7f795415d990 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.581+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276523863 0 0) 0x7f79540c7b50 con 0x7f79540c7d70 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.581+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f795415d500 con 0x7f79540c7d70 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.582+0000 7f79537fe640 1 -- 172.21.15.46:0/1042718555 >> v1:172.21.15.78:6789/0 conn(0x7f79540c7d70 legacy=0x7f79541640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.582+0000 7f79537fe640 1 -- 172.21.15.46:0/1042718555 >> v1:172.21.15.46:6789/0 conn(0x7f795415d990 legacy=0x7f7954159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.582+0000 7f79537fe640 1 -- 172.21.15.46:0/1042718555 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795415a1d0 con 0x7f795406b820 2024-01-27T14:00:44.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.584+0000 7f79537fe640 1 --2- 172.21.15.46:0/1042718555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f795406b820 0x7f795406bc00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79440097d0 tx=0x7f794402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b3c0e947ad38832 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.587+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944031890 con 0x7f795406b820 2024-01-27T14:00:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f79440319f0 con 0x7f795406b820 2024-01-27T14:00:44.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f79527fc640 1 -- 172.21.15.46:0/1042718555 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944031da0 con 0x7f795406b820 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 -- 172.21.15.46:0/1042718555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f795406b820 msgr2=0x7f795406bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 --2- 172.21.15.46:0/1042718555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f795406b820 0x7f795406bc00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79440097d0 tx=0x7f794402b930 comp rx=0 tx=0).stop 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 -- 172.21.15.46:0/1042718555 shutdown_connections 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 --2- 172.21.15.46:0/1042718555 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f795406b820 0x7f795406bc00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 -- 172.21.15.46:0/1042718555 >> 172.21.15.46:0/1042718555 conn(0x7f79540663a0 msgr2=0x7f79540667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 -- 172.21.15.46:0/1042718555 shutdown_connections 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.588+0000 7f7959fc5640 1 -- 172.21.15.46:0/1042718555 wait complete. 2024-01-27T14:00:44.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.589+0000 7f7959fc5640 1 Processor -- start 2024-01-27T14:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 -- start start 2024-01-27T14:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 0x7f79541e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79540c7d70 0x7f79541e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:44.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415d990 0x7f7954157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7954158560 con 0x7f795406b820 2024-01-27T14:00:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79541efec0 con 0x7f795415d990 2024-01-27T14:00:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.590+0000 7f7959fc5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79541f03f0 con 0x7f79540c7d70 2024-01-27T14:00:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.591+0000 7f79537fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 0x7f79541e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:44.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.591+0000 7f7952ffd640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79540c7d70 0x7f79541e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:44.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.591+0000 7f79537fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 0x7f79541e5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51148/0 (socket says 172.21.15.46:51148) 2024-01-27T14:00:44.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.591+0000 7f79537fe640 1 -- 172.21.15.46:0/2428889833 learned_addr learned my addr 172.21.15.46:0/2428889833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:44.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.591+0000 7f7953fff640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415d990 0x7f7954157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:44.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.594+0000 7f79537fe640 1 -- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79540c7d70 msgr2=0x7f79541e6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.594+0000 7f79537fe640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79540c7d70 0x7f79541e6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.594+0000 7f79537fe640 1 -- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415d990 msgr2=0x7f7954157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.594+0000 7f79537fe640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415d990 0x7f7954157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:44.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.594+0000 7f79537fe640 1 -- 172.21.15.46:0/2428889833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7944009400 con 0x7f795406b820 2024-01-27T14:00:44.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.597+0000 7f79537fe640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 0x7f79541e5640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f794402bf40 tx=0x7f79440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.601+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794403bcb0 con 0x7f795406b820 2024-01-27T14:00:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.601+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f794403be10 con 0x7f795406b820 2024-01-27T14:00:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.601+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944045650 con 0x7f795406b820 2024-01-27T14:00:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.601+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79541f0110 con 0x7f795406b820 2024-01-27T14:00:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.601+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795415c520 con 0x7f795406b820 2024-01-27T14:00:44.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.602+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7954074410 con 0x7f795406b820 2024-01-27T14:00:44.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.863+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f794404e450 con 0x7f795406b820 2024-01-27T14:00:44.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.863+0000 7f793bfff640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f794006af50 0x7f794006d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.863+0000 7f7952ffd640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f794006af50 0x7f794006d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:44.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.863+0000 7f7952ffd640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f794006af50 0x7f794006d410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79540c2af0 tx=0x7f7948009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:44.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.877+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f794407ab00 con 0x7f795406b820 2024-01-27T14:00:44.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:44.877+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7944076e40 con 0x7f795406b820 2024-01-27T14:00:45.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.059+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79541534f0 con 0x7f795406b820 2024-01-27T14:00:45.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.101+0000 7f793bfff640 1 -- 172.21.15.46:0/2428889833 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f7944035020 con 0x7f795406b820 2024-01-27T14:00:45.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-01-27T14:00:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"fsid":"cd306d9e-23fd-46fc-bd31-5e5759cfb03c","created":"2024-01-27T13:31:43.928150+0000","modified":"2024-01-27T13:32:51.335563+0000","last_up_change":"2024-01-27T13:31:58.380129+0000","last_in_change":"2024-01-27T13:31:49.577137+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-27T13:31:57.952816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-27T13:32:10.212389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-27T13:32:11.933652+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-01-27T13:32:15.934129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f4e9cd0b-5371-426a-850b-ea56d4b74e12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6803","nonce":3092334120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6805","nonce":3092334120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6809","nonce":3092334120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":3092334120},{"type":"v1","addr":"172.21.15.46:6807","nonce":3092334120}]},"public_addr":"172.21.15.46:6803/3092334120","cluster_addr":"172.21.15.46:6805/3092334120","heartbeat_back_addr":"172.21.15.46:6809/3092334120","heartbeat_front_addr":"172.21.15.46:6807/3092334120","state":["exists","up"]},{"osd":1,"uuid":"107b55a1-f6e1-433d-930d-5afe335184fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6811","nonce":2794574538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6813","nonce":2794574538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6817","nonce":2794574538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":2794574538},{"type":"v1","addr":"172.21.15.46:6815","nonce":2794574538}]},"public_addr":"172.21.15.46:6811/2794574538","cluster_addr":"172.21.15.46:6813/2794574538","heartbeat_back_addr":"172.21.15.46:6817/2794574538","heartbeat_front_addr":"172.21.15.46:6815/2794574538","state":["exists","up"]},{"osd":2,"uuid":"defebfaf-f581-43ba-a75e-8423d761d261","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6827","nonce":2828306015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6829","nonce":2828306015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6833","nonce":2828306015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":2828306015},{"type":"v1","addr":"172.21.15.46:6831","nonce":2828306015}]},"public_addr":"172.21.15.46:6827/2828306015","cluster_addr":"172.21.15.46:6829/2828306015","heartbeat_back_addr":"172.21.15.46:6833/2828306015","heartbeat_front_addr":"172.21.15.46:6831/2828306015","state":["exists","up"]},{"osd":3,"uuid":"e34eb7f7-424e-4a37-bdfa-01a681f92a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6819","nonce":3527109404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6821","nonce":3527109404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6825","nonce":3527109404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":3527109404},{"type":"v1","addr":"172.21.15.46:6823","nonce":3527109404}]},"public_addr":"172.21.15.46:6819/3527109404","cluster_addr":"172.21.15.46:6821/3527109404","heartbeat_back_addr":"172.21.15.46:6825/3527109404","heartbeat_front_addr":"172.21.15.46:6823/3527109404","state":["exists","up"]},{"osd":4,"uuid":"cf0fe755-2d81-4145-9088-bbf3ad06bd5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6810","nonce":3834088265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6814","nonce":3834088265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6822","nonce":3834088265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3834088265},{"type":"v1","addr":"172.21.15.78:6818","nonce":3834088265}]},"public_addr":"172.21.15.78:6810/3834088265","cluster_addr":"172.21.15.78:6814/3834088265","heartbeat_back_addr":"172.21.15.78:6822/3834088265","heartbeat_front_addr":"172.21.15.78:6818/3834088265","state":["exists","up"]},{"osd":5,"uuid":"83756c79-ff37-4eb9-9005-63307bec2a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6825","nonce":4205695749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6827","nonce":4205695749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6831","nonce":4205695749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4205695749},{"type":"v1","addr":"172.21.15.78:6829","nonce":4205695749}]},"public_addr":"172.21.15.78:6825/4205695749","cluster_addr":"172.21.15.78:6827/4205695749","heartbeat_back_addr":"172.21.15.78:6831/4205695749","heartbeat_front_addr":"172.21.15.78:6829/4205695749","state":["exists","up"]},{"osd":6,"uuid":"7cd312b5-647e-40ed-a7e8-c128e278cfea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6801","nonce":2551716118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6803","nonce":2551716118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6807","nonce":2551716118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2551716118},{"type":"v1","addr":"172.21.15.78:6805","nonce":2551716118}]},"public_addr":"172.21.15.78:6801/2551716118","cluster_addr":"172.21.15.78:6803/2551716118","heartbeat_back_addr":"172.21.15.78:6807/2551716118","heartbeat_front_addr":"172.21.15.78:6805/2551716118","state":["exists","up"]},{"osd":7,"uuid":"6f935d8e-c7e4-4899-9de2-94a36b6d2357","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6809","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6811","nonce":3083867566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6813","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6815","nonce":3083867566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6823","nonce":3083867566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3083867566},{"type":"v1","addr":"172.21.15.78:6819","nonce":3083867566}]},"public_addr":"172.21.15.78:6811/3083867566","cluster_addr":"172.21.15.78:6815/3083867566","heartbeat_back_addr":"172.21.15.78:6823/3083867566","heartbeat_front_addr":"172.21.15.78:6819/3083867566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.018741+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.164997+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.267097+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.212105+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.184214+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.147413+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.054008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-27T13:31:55.129869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-27T14:00:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f794006af50 msgr2=0x7f794006d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f794006af50 0x7f794006d410 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79540c2af0 tx=0x7f7948009040 comp rx=0 tx=0).stop 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 msgr2=0x7f79541e5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 0x7f79541e5640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f794402bf40 tx=0x7f79440046c0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 shutdown_connections 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f794006af50 0x7f794006d410 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415d990 0x7f7954157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f79540c7d70 0x7f79541e6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 --2- 172.21.15.46:0/2428889833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f795406b820 0x7f79541e5640 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 >> 172.21.15.46:0/2428889833 conn(0x7f79540663a0 msgr2=0x7f79540ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 shutdown_connections 2024-01-27T14:00:45.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.103+0000 7f7959fc5640 1 -- 172.21.15.46:0/2428889833 wait complete. 2024-01-27T14:00:45.101 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-27T14:00:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 Processor -- start 2024-01-27T14:00:45.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 -- start start 2024-01-27T14:00:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4c08150500 0x7f4c080c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c080c6260 0x7f4c080c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c080c6c10 con 0x7f4c080c1e80 2024-01-27T14:00:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c080c7780 con 0x7f4c080c6260 2024-01-27T14:00:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.217+0000 7f4c0f00e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c081508e0 con 0x7f4c08150500 2024-01-27T14:00:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.218+0000 7f4c0d5ab640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c080c6260 0x7f4c080c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.218+0000 7f4c0cdaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4c08150500 0x7f4c080c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.218+0000 7f4c0d5ab640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4c080c6260 0x7f4c080c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51164/0 (socket says 172.21.15.46:51164) 2024-01-27T14:00:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.218+0000 7f4c0d5ab640 1 -- 172.21.15.46:0/2527454468 learned_addr learned my addr 172.21.15.46:0/2527454468 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.221+0000 7f4c0d5ab640 1 -- 172.21.15.46:0/2527454468 >> v2:172.21.15.78:3300/0 conn(0x7f4c08150500 msgr2=0x7f4c080c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.221+0000 7f4c0d5ab640 1 --2- 172.21.15.46:0/2527454468 >> v2:172.21.15.78:3300/0 conn(0x7f4c08150500 0x7f4c080c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.221+0000 7f4c0d5ab640 1 -- 172.21.15.46:0/2527454468 >> v1:172.21.15.78:6789/0 conn(0x7f4c080c1e80 legacy=0x7f4c080bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.221+0000 7f4c0d5ab640 1 -- 172.21.15.46:0/2527454468 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08156600 con 0x7f4c080c6260 2024-01-27T14:00:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.223+0000 7f4c0d5ab640 1 --2- 172.21.15.46:0/2527454468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c6260 0x7f4c080c66d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806c3b0 tx=0x7f4bf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3984454b539316 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:45.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c077fe640 1 -- 172.21.15.46:0/2527454468 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8031870 con 0x7f4c080c6260 2024-01-27T14:00:45.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c077fe640 1 -- 172.21.15.46:0/2527454468 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bf80319d0 con 0x7f4c080c6260 2024-01-27T14:00:45.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c077fe640 1 -- 172.21.15.46:0/2527454468 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8031d80 con 0x7f4c080c6260 2024-01-27T14:00:45.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 -- 172.21.15.46:0/2527454468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c6260 msgr2=0x7f4c080c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/2527454468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c6260 0x7f4c080c66d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806c3b0 tx=0x7f4bf802b910 comp rx=0 tx=0).stop 2024-01-27T14:00:45.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 -- 172.21.15.46:0/2527454468 shutdown_connections 2024-01-27T14:00:45.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/2527454468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c6260 0x7f4c080c66d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/2527454468 >> v2:172.21.15.78:3300/0 conn(0x7f4c08150500 0x7f4c080c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 -- 172.21.15.46:0/2527454468 >> 172.21.15.46:0/2527454468 conn(0x7f4c080cae90 msgr2=0x7f4c080cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.227+0000 7f4c0f00e640 1 -- 172.21.15.46:0/2527454468 shutdown_connections 2024-01-27T14:00:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.228+0000 7f4c0f00e640 1 -- 172.21.15.46:0/2527454468 wait complete. 2024-01-27T14:00:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.229+0000 7f4c0f00e640 1 Processor -- start 2024-01-27T14:00:45.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.229+0000 7f4c0f00e640 1 -- start start 2024-01-27T14:00:45.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0f00e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c1e80 0x7f4c0806d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:45.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0f00e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 0x7f4c080c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:45.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0f00e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c08150500 0x7f4c080c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:45.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0f00e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c37c0 con 0x7f4c080c1e80 2024-01-27T14:00:45.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0f00e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c4190 con 0x7f4c080c6260 2024-01-27T14:00:45.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0f00e640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c4470 con 0x7f4c08150500 2024-01-27T14:00:45.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 0x7f4c080c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:45.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.230+0000 7f4c0d5ab640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c08150500 0x7f4c080c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:45.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.231+0000 7f4c07fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 0x7f4c080c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.46:46630/0 (socket says 172.21.15.46:46630) 2024-01-27T14:00:45.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.231+0000 7f4c07fff640 1 -- 172.21.15.46:0/247402262 learned_addr learned my addr 172.21.15.46:0/247402262 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:45.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.231+0000 7f4c0cdaa640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c1e80 0x7f4c0806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.234+0000 7f4c07fff640 1 -- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c08150500 msgr2=0x7f4c080c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.234+0000 7f4c07fff640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c08150500 0x7f4c080c29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.234+0000 7f4c07fff640 1 -- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c1e80 msgr2=0x7f4c0806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.234+0000 7f4c07fff640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c1e80 0x7f4c0806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.234+0000 7f4c07fff640 1 -- 172.21.15.46:0/247402262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80094d0 con 0x7f4c080c6260 2024-01-27T14:00:45.222 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.236+0000 7f4c07fff640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 0x7f4c080c2490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b3c0 tx=0x7f4bf000b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:45.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.242+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0011830 con 0x7f4c080c6260 2024-01-27T14:00:45.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.242+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bf0011990 con 0x7f4c080c6260 2024-01-27T14:00:45.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.242+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0011da0 con 0x7f4c080c6260 2024-01-27T14:00:45.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.242+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c080c39d0 con 0x7f4c080c6260 2024-01-27T14:00:45.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.242+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0806dde0 con 0x7f4c080c6260 2024-01-27T14:00:45.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.243+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c08074410 con 0x7f4c080c6260 2024-01-27T14:00:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.483+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4bf0004020 con 0x7f4c080c6260 2024-01-27T14:00:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.484+0000 7f4c057fa640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4be806af20 0x7f4be806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:45.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.484+0000 7f4c0cdaa640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4be806af20 0x7f4be806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:45.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.484+0000 7f4c0cdaa640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4be806af20 0x7f4be806d3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c000113e0 tx=0x7f4c0000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:45.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.487+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4bf0058350 con 0x7f4c080c6260 2024-01-27T14:00:45.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.497+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4bf0054690 con 0x7f4c080c6260 2024-01-27T14:00:45.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.716+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4c08072b90 con 0x7f4c080c6260 2024-01-27T14:00:45.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.923+0000 7f4c057fa640 1 -- 172.21.15.46:0/247402262 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4bf0057cb0 con 0x7f4c080c6260 2024-01-27T14:00:45.909 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-27T14:00:45.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4be806af20 msgr2=0x7f4be806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4be806af20 0x7f4be806d3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c000113e0 tx=0x7f4c0000b040 comp rx=0 tx=0).stop 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 msgr2=0x7f4c080c2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 0x7f4c080c2490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b3c0 tx=0x7f4bf000b880 comp rx=0 tx=0).stop 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 shutdown_connections 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f4be806af20 0x7f4be806d3e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4c08150500 0x7f4c080c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c080c6260 0x7f4c080c2490 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 --2- 172.21.15.46:0/247402262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c080c1e80 0x7f4c0806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 >> 172.21.15.46:0/247402262 conn(0x7f4c080cae90 msgr2=0x7f4c08071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 shutdown_connections 2024-01-27T14:00:45.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:45.925+0000 7f4c0f00e640 1 -- 172.21.15.46:0/247402262 wait complete. 2024-01-27T14:00:45.925 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-27T14:00:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.044+0000 7f564262b640 1 Processor -- start 2024-01-27T14:00:46.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.044+0000 7f564262b640 1 -- start start 2024-01-27T14:00:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f564262b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f563c0c28c0 0x7f563c0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f564262b640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f563c0c2ca0 0x7f563c1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f564262b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563c0ccf60 con 0x7f563c0c77d0 2024-01-27T14:00:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f564262b640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c0ca800 con 0x7f563c0c2ca0 2024-01-27T14:00:46.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f564262b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563c1576d0 con 0x7f563c0c28c0 2024-01-27T14:00:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f563b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f563c0c2ca0 0x7f563c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.045+0000 7f563bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f563c0c28c0 0x7f563c0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.046+0000 7f563b7fe640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f563c0c2ca0 0x7f563c1514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51180/0 (socket says 172.21.15.46:51180) 2024-01-27T14:00:46.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.046+0000 7f563b7fe640 1 -- 172.21.15.46:0/4062001376 learned_addr learned my addr 172.21.15.46:0/4062001376 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.049+0000 7f563bfff640 1 -- 172.21.15.46:0/4062001376 >> v2:172.21.15.46:3300/0 conn(0x7f563c0c2ca0 msgr2=0x7f563c1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.049+0000 7f563bfff640 1 --2- 172.21.15.46:0/4062001376 >> v2:172.21.15.46:3300/0 conn(0x7f563c0c2ca0 0x7f563c1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.049+0000 7f563bfff640 1 -- 172.21.15.46:0/4062001376 >> v1:172.21.15.78:6789/0 conn(0x7f563c0c77d0 legacy=0x7f563c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:46.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.049+0000 7f563bfff640 1 -- 172.21.15.46:0/4062001376 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0cd200 con 0x7f563c0c28c0 2024-01-27T14:00:46.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.052+0000 7f563bfff640 1 --2- 172.21.15.46:0/4062001376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c28c0 0x7f563c0c1cd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f562c0097a0 tx=0x7f562c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b46055f172430a server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.056+0000 7f563affd640 1 -- 172.21.15.46:0/4062001376 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c031830 con 0x7f563c0c28c0 2024-01-27T14:00:46.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.056+0000 7f563affd640 1 -- 172.21.15.46:0/4062001376 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f562c031990 con 0x7f563c0c28c0 2024-01-27T14:00:46.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.056+0000 7f563affd640 1 -- 172.21.15.46:0/4062001376 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c031d40 con 0x7f563c0c28c0 2024-01-27T14:00:46.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 -- 172.21.15.46:0/4062001376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c28c0 msgr2=0x7f563c0c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:46.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 --2- 172.21.15.46:0/4062001376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c28c0 0x7f563c0c1cd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f562c0097a0 tx=0x7f562c02b8d0 comp rx=0 tx=0).stop 2024-01-27T14:00:46.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 -- 172.21.15.46:0/4062001376 shutdown_connections 2024-01-27T14:00:46.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 --2- 172.21.15.46:0/4062001376 >> v2:172.21.15.46:3300/0 conn(0x7f563c0c2ca0 0x7f563c1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 --2- 172.21.15.46:0/4062001376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c28c0 0x7f563c0c1cd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 -- 172.21.15.46:0/4062001376 >> 172.21.15.46:0/4062001376 conn(0x7f563c06efe0 msgr2=0x7f563c06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 -- 172.21.15.46:0/4062001376 shutdown_connections 2024-01-27T14:00:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.057+0000 7f564262b640 1 -- 172.21.15.46:0/4062001376 wait complete. 2024-01-27T14:00:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.058+0000 7f564262b640 1 Processor -- start 2024-01-27T14:00:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.058+0000 7f564262b640 1 -- start start 2024-01-27T14:00:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f564262b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f563c0c28c0 0x7f563c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f564262b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c2ca0 0x7f563c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f564262b640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f563c0c77d0 0x7f563c1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f564262b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1e2da0 con 0x7f563c0c28c0 2024-01-27T14:00:46.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f564262b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c06c360 con 0x7f563c0c2ca0 2024-01-27T14:00:46.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f564262b640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563c1e2ac0 con 0x7f563c0c77d0 2024-01-27T14:00:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.059+0000 7f563bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f563c0c28c0 0x7f563c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.060+0000 7f563b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c2ca0 0x7f563c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.060+0000 7f5640bc8640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f563c0c77d0 0x7f563c1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.060+0000 7f563bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f563c0c28c0 0x7f563c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51186/0 (socket says 172.21.15.46:51186) 2024-01-27T14:00:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.060+0000 7f563bfff640 1 -- 172.21.15.46:0/3058673283 learned_addr learned my addr 172.21.15.46:0/3058673283 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:46.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.063+0000 7f563b7fe640 1 -- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f563c0c77d0 msgr2=0x7f563c1f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:46.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.063+0000 7f563b7fe640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f563c0c77d0 0x7f563c1f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:46.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.063+0000 7f563b7fe640 1 -- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f563c0c28c0 msgr2=0x7f563c0cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:46.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.063+0000 7f563b7fe640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f563c0c28c0 0x7f563c0cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:46.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.063+0000 7f563b7fe640 1 -- 172.21.15.46:0/3058673283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c009400 con 0x7f563c0c2ca0 2024-01-27T14:00:46.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.065+0000 7f563b7fe640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c2ca0 0x7f563c14d0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f563c1552c0 tx=0x7f563000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:46.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.069+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000c940 con 0x7f563c0c2ca0 2024-01-27T14:00:46.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.069+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f563000caa0 con 0x7f563c0c2ca0 2024-01-27T14:00:46.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.069+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c06b9c0 con 0x7f563c0c2ca0 2024-01-27T14:00:46.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.069+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563000ce30 con 0x7f563c0c2ca0 2024-01-27T14:00:46.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.069+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c06bf80 con 0x7f563c0c2ca0 2024-01-27T14:00:46.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.069+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c074410 con 0x7f563c0c2ca0 2024-01-27T14:00:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.088+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5630013470 con 0x7f563c0c2ca0 2024-01-27T14:00:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.088+0000 7f5638ff9640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f562806af50 0x7f562806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:46.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.088+0000 7f563bfff640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f562806af50 0x7f562806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:46.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.089+0000 7f563bfff640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f562806af50 0x7f562806d410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f562c02b910 tx=0x7f562c03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:46.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.312+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5630058aa0 con 0x7f563c0c2ca0 2024-01-27T14:00:46.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.321+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5630054de0 con 0x7f563c0c2ca0 2024-01-27T14:00:46.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:46.546+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f563c0c7e20 con 0x7f563c0c2ca0 2024-01-27T14:00:47.070 INFO:tasks.ceph.mds.e.smithi046.stderr:==00:00:28:47.564 40726== 2024-01-27T14:00:47.071 INFO:tasks.ceph.mds.e.smithi046.stderr:==00:00:28:47.564 40726== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T14:00:47.153 INFO:tasks.ceph.mds.e.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T14:00:47.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.709+0000 7f5638ff9640 1 -- 172.21.15.46:0/3058673283 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f56300170a0 con 0x7f563c0c2ca0 2024-01-27T14:00:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f562806af50 msgr2=0x7f562806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f562806af50 0x7f562806d410 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f562c02b910 tx=0x7f562c03c040 comp rx=0 tx=0).stop 2024-01-27T14:00:47.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c2ca0 msgr2=0x7f563c14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c2ca0 0x7f563c14d0a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f563c1552c0 tx=0x7f563000ecb0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 shutdown_connections 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f562806af50 0x7f562806d410 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f563c0c77d0 0x7f563c1f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f563c0c2ca0 0x7f563c14d0a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 --2- 172.21.15.46:0/3058673283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f563c0c28c0 0x7f563c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.711+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 >> 172.21.15.46:0/3058673283 conn(0x7f563c06efe0 msgr2=0x7f563c0c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.712+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 shutdown_connections 2024-01-27T14:00:47.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.712+0000 7f564262b640 1 -- 172.21.15.46:0/3058673283 wait complete. 2024-01-27T14:00:47.709 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-27T14:00:47.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.828+0000 7fd0ab4e5640 1 Processor -- start 2024-01-27T14:00:47.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.828+0000 7fd0ab4e5640 1 -- start start 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.829+0000 7fd0ab4e5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4153a90 0x7fd0a40c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.829+0000 7fd0ab4e5640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a415d8c0 con 0x7fd0a40c3390 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.829+0000 7fd0ab4e5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a415dd50 con 0x7fd0a4159990 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.829+0000 7fd0ab4e5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40ca1e0 con 0x7fd0a4153a90 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.829+0000 7fd0a9a82640 1 --1- >> v1:172.21.15.46:6789/0 conn(0x7fd0a40c3390 0x7fd0a40c9250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.46:6789/0 says I am v1:172.21.15.46:49090/0 (socket says 172.21.15.46:49090) 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.829+0000 7fd0a9a82640 1 -- 172.21.15.46:0/3012201459 learned_addr learned my addr 172.21.15.46:0/3012201459 (peer_addr_for_me v1:172.21.15.46:0/0) 2024-01-27T14:00:47.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.830+0000 7fd0a9281640 1 --2- 172.21.15.46:0/3012201459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4153a90 0x7fd0a40c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:47.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.832+0000 7fd09bfff640 1 -- 172.21.15.46:0/3012201459 <== mon.1 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657221887 0 0) 0x7fd0a415dd50 con 0x7fd0a4159990 2024-01-27T14:00:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.832+0000 7fd09bfff640 1 -- 172.21.15.46:0/3012201459 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd090003520 con 0x7fd0a4159990 2024-01-27T14:00:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.832+0000 7fd0a9281640 1 -- 172.21.15.46:0/3012201459 >> v1:172.21.15.78:6789/0 conn(0x7fd0a4159990 legacy=0x7fd0a40c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.832+0000 7fd0a9281640 1 -- 172.21.15.46:0/3012201459 >> v1:172.21.15.46:6789/0 conn(0x7fd0a40c3390 legacy=0x7fd0a40c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.832+0000 7fd09bfff640 1 -- 172.21.15.46:0/3012201459 <== mon.0 v1:172.21.15.46:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742515505 0 0) 0x7fd0a415d8c0 con 0x7fd0a40c3390 2024-01-27T14:00:47.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.832+0000 7fd0a9281640 1 -- 172.21.15.46:0/3012201459 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40c9f00 con 0x7fd0a4153a90 2024-01-27T14:00:47.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.834+0000 7fd0a9281640 1 --2- 172.21.15.46:0/3012201459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4153a90 0x7fd0a40c2e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009dc0 tx=0x7fd09c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b02a0c2a7069eba server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.838+0000 7fd09bfff640 1 -- 172.21.15.46:0/3012201459 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c02cd50 con 0x7fd0a4153a90 2024-01-27T14:00:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.838+0000 7fd09bfff640 1 -- 172.21.15.46:0/3012201459 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd09c034440 con 0x7fd0a4153a90 2024-01-27T14:00:47.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.838+0000 7fd09bfff640 1 -- 172.21.15.46:0/3012201459 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0347f0 con 0x7fd0a4153a90 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/3012201459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4153a90 msgr2=0x7fd0a40c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/3012201459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4153a90 0x7fd0a40c2e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009dc0 tx=0x7fd09c02bfa0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/3012201459 shutdown_connections 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/3012201459 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4153a90 0x7fd0a40c2e50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/3012201459 >> 172.21.15.46:0/3012201459 conn(0x7fd0a40663a0 msgr2=0x7fd0a4066780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/3012201459 shutdown_connections 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.839+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/3012201459 wait complete. 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.840+0000 7fd0ab4e5640 1 Processor -- start 2024-01-27T14:00:47.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.840+0000 7fd0ab4e5640 1 -- start start 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.840+0000 7fd0ab4e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 0x7fd0a40cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.840+0000 7fd0ab4e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a4153a90 0x7fd0a41f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0ab4e5640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4159990 0x7fd0a41f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0ab4e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a41f3300 con 0x7fd0a40c3390 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0ab4e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a415c7f0 con 0x7fd0a4153a90 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0ab4e5640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a41f3020 con 0x7fd0a4159990 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0a9281640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 0x7fd0a40cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0a9a82640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4159990 0x7fd0a41f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0a8a80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a4153a90 0x7fd0a41f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0a9281640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 0x7fd0a40cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51202/0 (socket says 172.21.15.46:51202) 2024-01-27T14:00:47.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.841+0000 7fd0a9281640 1 -- 172.21.15.46:0/881353576 learned_addr learned my addr 172.21.15.46:0/881353576 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.845+0000 7fd0a9a82640 1 -- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a4153a90 msgr2=0x7fd0a41f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.845+0000 7fd0a9a82640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a4153a90 0x7fd0a41f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.845+0000 7fd0a9a82640 1 -- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 msgr2=0x7fd0a40cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.845+0000 7fd0a9a82640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 0x7fd0a40cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.845+0000 7fd0a9a82640 1 -- 172.21.15.46:0/881353576 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c009a70 con 0x7fd0a4159990 2024-01-27T14:00:47.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.845+0000 7fd0a9281640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 0x7fd0a40cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:00:47.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.847+0000 7fd0a9a82640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4159990 0x7fd0a41f1630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.851+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00074e0 con 0x7fd0a4159990 2024-01-27T14:00:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.851+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd0a0007640 con 0x7fd0a4159990 2024-01-27T14:00:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.851+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0004a40 con 0x7fd0a4159990 2024-01-27T14:00:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.851+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a41f0e30 con 0x7fd0a4159990 2024-01-27T14:00:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.851+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a406d330 con 0x7fd0a4159990 2024-01-27T14:00:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.852+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a41f1350 con 0x7fd0a4159990 2024-01-27T14:00:47.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.870+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd0a0004ba0 con 0x7fd0a4159990 2024-01-27T14:00:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.870+0000 7fd099ffb640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd08806af20 0x7fd08806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.870+0000 7fd0a9281640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd08806af20 0x7fd08806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:47.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.870+0000 7fd0a9281640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd08806af20 0x7fd08806d3e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd09c02bfe0 tx=0x7fd09c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:47.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:47.873+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fd0a00583e0 con 0x7fd0a4159990 2024-01-27T14:00:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.109+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd0a0054720 con 0x7fd0a4159990 2024-01-27T14:00:48.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.286+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0a41f1350 con 0x7fd0a4159990 2024-01-27T14:00:48.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.813+0000 7fd099ffb640 1 -- 172.21.15.46:0/881353576 <== mon.2 v2:172.21.15.78:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd0a41f1350 con 0x7fd0a4159990 2024-01-27T14:00:48.800 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-01-27T14:00:48.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd08806af20 msgr2=0x7fd08806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd08806af20 0x7fd08806d3e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd09c02bfe0 tx=0x7fd09c030000 comp rx=0 tx=0).stop 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4159990 msgr2=0x7fd0a41f1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4159990 0x7fd0a41f1630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a000c870 comp rx=0 tx=0).stop 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 shutdown_connections 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7fd08806af20 0x7fd08806d3e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7fd0a4159990 0x7fd0a41f1630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0a4153a90 0x7fd0a41f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 --2- 172.21.15.46:0/881353576 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0a40c3390 0x7fd0a40cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 >> 172.21.15.46:0/881353576 conn(0x7fd0a40663a0 msgr2=0x7fd0a4157500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 shutdown_connections 2024-01-27T14:00:48.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.816+0000 7fd0ab4e5640 1 -- 172.21.15.46:0/881353576 wait complete. 2024-01-27T14:00:48.814 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-27T14:00:48.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.932+0000 7f432aa5d640 1 Processor -- start 2024-01-27T14:00:48.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.932+0000 7f432aa5d640 1 -- start start 2024-01-27T14:00:48.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.933+0000 7f432aa5d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f43240ca0a0 0x7f432406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.933+0000 7f432aa5d640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4324153d20 0x7f432415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.933+0000 7f432aa5d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43240c5420 con 0x7f43240ca480 2024-01-27T14:00:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.933+0000 7f432aa5d640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432415a800 con 0x7f4324153d20 2024-01-27T14:00:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.933+0000 7f432aa5d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43240cac50 con 0x7f43240ca0a0 2024-01-27T14:00:48.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.934+0000 7f4328ffa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4324153d20 0x7f432415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:48.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.934+0000 7f4328ffa640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f4324153d20 0x7f432415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51218/0 (socket says 172.21.15.46:51218) 2024-01-27T14:00:48.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.934+0000 7f4328ffa640 1 -- 172.21.15.46:0/2379967026 learned_addr learned my addr 172.21.15.46:0/2379967026 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:48.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.934+0000 7f4323fff640 1 --2- 172.21.15.46:0/2379967026 >> v2:172.21.15.78:3300/0 conn(0x7f43240ca0a0 0x7f432406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.936+0000 7f4328ffa640 1 -- 172.21.15.46:0/2379967026 >> v2:172.21.15.78:3300/0 conn(0x7f43240ca0a0 msgr2=0x7f432406d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.936+0000 7f4328ffa640 1 --2- 172.21.15.46:0/2379967026 >> v2:172.21.15.78:3300/0 conn(0x7f43240ca0a0 0x7f432406d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.936+0000 7f4328ffa640 1 -- 172.21.15.46:0/2379967026 >> v1:172.21.15.78:6789/0 conn(0x7f43240ca480 legacy=0x7f4324153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:48.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.936+0000 7f4328ffa640 1 -- 172.21.15.46:0/2379967026 --> v2:172.21.15.46:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240c4340 con 0x7f4324153d20 2024-01-27T14:00:48.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.939+0000 7f4328ffa640 1 --2- 172.21.15.46:0/2379967026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4324153d20 0x7f432415a2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f431c009e50 tx=0x7f431c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d2633d17c049b server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:48.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f4322ffd640 1 -- 172.21.15.46:0/2379967026 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c02cbb0 con 0x7f4324153d20 2024-01-27T14:00:48.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f4322ffd640 1 -- 172.21.15.46:0/2379967026 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f431c02cd10 con 0x7f4324153d20 2024-01-27T14:00:48.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f4322ffd640 1 -- 172.21.15.46:0/2379967026 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c034630 con 0x7f4324153d20 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 -- 172.21.15.46:0/2379967026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4324153d20 msgr2=0x7f432415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2379967026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4324153d20 0x7f432415a2c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f431c009e50 tx=0x7f431c02c010 comp rx=0 tx=0).stop 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 -- 172.21.15.46:0/2379967026 shutdown_connections 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2379967026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4324153d20 0x7f432415a2c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2379967026 >> v2:172.21.15.78:3300/0 conn(0x7f43240ca0a0 0x7f432406d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 -- 172.21.15.46:0/2379967026 >> 172.21.15.46:0/2379967026 conn(0x7f432408b660 msgr2=0x7f43240663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 -- 172.21.15.46:0/2379967026 shutdown_connections 2024-01-27T14:00:48.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.943+0000 7f432aa5d640 1 -- 172.21.15.46:0/2379967026 wait complete. 2024-01-27T14:00:48.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.945+0000 7f432aa5d640 1 Processor -- start 2024-01-27T14:00:48.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.945+0000 7f432aa5d640 1 -- start start 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.945+0000 7f432aa5d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43240ca0a0 0x7f43240ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f432aa5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 0x7f43241574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f432aa5d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4324153d20 0x7f4324148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f432aa5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240cd070 con 0x7f43240ca480 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f432aa5d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43240cde30 con 0x7f43240ca0a0 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f432aa5d640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43240cd260 con 0x7f4324153d20 2024-01-27T14:00:48.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f43237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 0x7f43241574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:48.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f43237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 0x7f43241574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51232/0 (socket says 172.21.15.46:51232) 2024-01-27T14:00:48.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f43237fe640 1 -- 172.21.15.46:0/2539671036 learned_addr learned my addr 172.21.15.46:0/2539671036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:48.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f4323fff640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43240ca0a0 0x7f43240ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:48.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.946+0000 7f4328ffa640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4324153d20 0x7f4324148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:48.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.950+0000 7f43237fe640 1 -- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4324153d20 msgr2=0x7f4324148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:48.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.950+0000 7f43237fe640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4324153d20 0x7f4324148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.950+0000 7f43237fe640 1 -- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43240ca0a0 msgr2=0x7f43240ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:48.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.950+0000 7f43237fe640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43240ca0a0 0x7f43240ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:48.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.950+0000 7f43237fe640 1 -- 172.21.15.46:0/2539671036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009b30 con 0x7f43240ca480 2024-01-27T14:00:48.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.952+0000 7f43237fe640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 0x7f43241574c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f431800c470 tx=0x7f4318001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.956+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180052d0 con 0x7f43240ca480 2024-01-27T14:00:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.956+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4318005430 con 0x7f43240ca480 2024-01-27T14:00:48.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.956+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4318007280 con 0x7f43240ca480 2024-01-27T14:00:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.956+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43240cd500 con 0x7f43240ca480 2024-01-27T14:00:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.956+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43240cdac0 con 0x7f43240ca480 2024-01-27T14:00:48.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.957+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43240cdc50 con 0x7f43240ca480 2024-01-27T14:00:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.976+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f43180073e0 con 0x7f43240ca480 2024-01-27T14:00:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.976+0000 7f4320ff9640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f431006af00 0x7f431006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.976+0000 7f4323fff640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f431006af00 0x7f431006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:48.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.977+0000 7f4323fff640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f431006af00 0x7f431006d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4314009b40 tx=0x7f4314009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:48.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:48.980+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f4318004f00 con 0x7f43240ca480 2024-01-27T14:00:49.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.230+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4318053d00 con 0x7f43240ca480 2024-01-27T14:00:49.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.408+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43240c5420 con 0x7f43240ca480 2024-01-27T14:00:49.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.842+0000 7f4320ff9640 1 -- 172.21.15.46:0/2539671036 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f43240c5420 con 0x7f43240ca480 2024-01-27T14:00:49.829 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f431006af00 msgr2=0x7f431006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f431006af00 0x7f431006d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4314009b40 tx=0x7f4314009190 comp rx=0 tx=0).stop 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 msgr2=0x7f43241574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 0x7f43241574c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f431800c470 tx=0x7f4318001e70 comp rx=0 tx=0).stop 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 shutdown_connections 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7f431006af00 0x7f431006d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f4324153d20 0x7f4324148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43240ca480 0x7f43241574c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 --2- 172.21.15.46:0/2539671036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43240ca0a0 0x7f43240ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 >> 172.21.15.46:0/2539671036 conn(0x7f432408b660 msgr2=0x7f43240b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 shutdown_connections 2024-01-27T14:00:49.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.844+0000 7f432aa5d640 1 -- 172.21.15.46:0/2539671036 wait complete. 2024-01-27T14:00:49.842 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-01-27T14:00:49.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.971+0000 7f00073d1640 1 Processor -- start 2024-01-27T14:00:49.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.971+0000 7f00073d1640 1 -- start start 2024-01-27T14:00:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.972+0000 7f00073d1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 0x7f000006d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.972+0000 7f00073d1640 1 --2- >> v2:172.21.15.46:3300/0 conn(0x7f00000ca480 0x7f000015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.972+0000 7f00073d1640 1 -- --> v1:172.21.15.46:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00000c5420 con 0x7f0000153610 2024-01-27T14:00:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.972+0000 7f00073d1640 1 -- --> v2:172.21.15.46:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000015a800 con 0x7f00000ca480 2024-01-27T14:00:49.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.972+0000 7f00073d1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000cac50 con 0x7f00000ca0a0 2024-01-27T14:00:49.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.972+0000 7f000516d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 0x7f000006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:49.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.973+0000 7f000516d640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 0x7f000006d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3301/0 says I am v2:172.21.15.46:49336/0 (socket says 172.21.15.46:49336) 2024-01-27T14:00:49.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.973+0000 7f000516d640 1 -- 172.21.15.46:0/10347517 learned_addr learned my addr 172.21.15.46:0/10347517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:49.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.975+0000 7f000516d640 1 -- 172.21.15.46:0/10347517 >> v2:172.21.15.46:3300/0 conn(0x7f00000ca480 msgr2=0x7f000015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:49.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.975+0000 7f000516d640 1 --2- 172.21.15.46:0/10347517 >> v2:172.21.15.46:3300/0 conn(0x7f00000ca480 0x7f000015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.975+0000 7f000516d640 1 -- 172.21.15.46:0/10347517 >> v1:172.21.15.46:6789/0 conn(0x7f0000153610 legacy=0x7f000006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-27T14:00:49.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.975+0000 7f000516d640 1 -- 172.21.15.46:0/10347517 --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000c4340 con 0x7f00000ca0a0 2024-01-27T14:00:49.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.977+0000 7f000516d640 1 --2- 172.21.15.46:0/10347517 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 0x7f000006d140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efffc009870 tx=0x7efffc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc051a2675df1746 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:49.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7efff7fff640 1 -- 172.21.15.46:0/10347517 <== mon.2 v2:172.21.15.78:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc030840 con 0x7f00000ca0a0 2024-01-27T14:00:49.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7efff7fff640 1 -- 172.21.15.46:0/10347517 <== mon.2 v2:172.21.15.78:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efffc0309a0 con 0x7f00000ca0a0 2024-01-27T14:00:49.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7efff7fff640 1 -- 172.21.15.46:0/10347517 <== mon.2 v2:172.21.15.78:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc030d50 con 0x7f00000ca0a0 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 -- 172.21.15.46:0/10347517 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 msgr2=0x7f000006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 --2- 172.21.15.46:0/10347517 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 0x7f000006d140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efffc009870 tx=0x7efffc02b980 comp rx=0 tx=0).stop 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 -- 172.21.15.46:0/10347517 shutdown_connections 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 --2- 172.21.15.46:0/10347517 >> v2:172.21.15.46:3300/0 conn(0x7f00000ca480 0x7f000015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 --2- 172.21.15.46:0/10347517 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f00000ca0a0 0x7f000006d140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 -- 172.21.15.46:0/10347517 >> 172.21.15.46:0/10347517 conn(0x7f000008b660 msgr2=0x7f00000663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 -- 172.21.15.46:0/10347517 shutdown_connections 2024-01-27T14:00:49.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.982+0000 7f00073d1640 1 -- 172.21.15.46:0/10347517 wait complete. 2024-01-27T14:00:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.983+0000 7f00073d1640 1 Processor -- start 2024-01-27T14:00:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 -- start start 2024-01-27T14:00:49.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00000ca0a0 0x7f00001f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00000ca480 0x7f0000151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0000153610 0x7f0000145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000151780 con 0x7f00000ca0a0 2024-01-27T14:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0000146350 con 0x7f00000ca480 2024-01-27T14:00:49.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.984+0000 7f00073d1640 1 -- --> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00001f3870 con 0x7f0000153610 2024-01-27T14:00:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.985+0000 7f000516d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00000ca0a0 0x7f00001f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.985+0000 7f000596e640 1 --2- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0000153610 0x7f0000145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.985+0000 7f000516d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00000ca0a0 0x7f00001f0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51238/0 (socket says 172.21.15.46:51238) 2024-01-27T14:00:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.985+0000 7f000516d640 1 -- 172.21.15.46:0/258109005 learned_addr learned my addr 172.21.15.46:0/258109005 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-01-27T14:00:49.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.985+0000 7f000496c640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00000ca480 0x7f0000151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.989+0000 7f000496c640 1 -- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0000153610 msgr2=0x7f0000145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.989+0000 7f000496c640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0000153610 0x7f0000145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.989+0000 7f000496c640 1 -- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00000ca0a0 msgr2=0x7f00001f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.989+0000 7f000496c640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00000ca0a0 0x7f00001f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.989+0000 7f000496c640 1 -- 172.21.15.46:0/258109005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0094d0 con 0x7f00000ca480 2024-01-27T14:00:49.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.989+0000 7f000596e640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0000153610 0x7f0000145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-27T14:00:49.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.991+0000 7f000496c640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00000ca480 0x7f0000151c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efff000b3f0 tx=0x7efff000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.994+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0011830 con 0x7f00000ca480 2024-01-27T14:00:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.994+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efff0011990 con 0x7f00000ca480 2024-01-27T14:00:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.994+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0011d60 con 0x7f00000ca480 2024-01-27T14:00:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.994+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00001f3b50 con 0x7f00000ca480 2024-01-27T14:00:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.994+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0000151130 con 0x7f00000ca480 2024-01-27T14:00:49.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:49.995+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0000151930 con 0x7f00000ca480 2024-01-27T14:00:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.013+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7efff001a400 con 0x7f00000ca480 2024-01-27T14:00:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.014+0000 7efff5ffb640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effe406af50 0x7effe406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-27T14:00:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.014+0000 7f000516d640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effe406af50 0x7effe406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-27T14:00:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.014+0000 7f000516d640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effe406af50 0x7effe406d410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efffc009870 tx=0x7efffc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-27T14:00:50.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.015+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7efff0058640 con 0x7f00000ca480 2024-01-27T14:00:50.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.257+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7efff0054980 con 0x7f00000ca480 2024-01-27T14:00:50.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.438+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00001518f0 con 0x7f00000ca480 2024-01-27T14:00:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.910+0000 7efff5ffb640 1 -- 172.21.15.46:0/258109005 <== mon.1 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7efff0015070 con 0x7f00000ca480 2024-01-27T14:00:50.896 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data_ec' removed 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effe406af50 msgr2=0x7effe406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effe406af50 0x7effe406d410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efffc009870 tx=0x7efffc008030 comp rx=0 tx=0).stop 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00000ca480 msgr2=0x7f0000151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00000ca480 0x7f0000151c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efff000b3f0 tx=0x7efff000b8b0 comp rx=0 tx=0).stop 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 shutdown_connections 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:6800/805234491,v1:172.21.15.46:6801/805234491] conn(0x7effe406af50 0x7effe406d410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x7f0000153610 0x7f0000145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00000ca480 0x7f0000151c10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 --2- 172.21.15.46:0/258109005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00000ca0a0 0x7f00001f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 >> 172.21.15.46:0/258109005 conn(0x7f000008b660 msgr2=0x7f00000b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.914+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 shutdown_connections 2024-01-27T14:00:50.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-01-27T14:00:50.915+0000 7f00073d1640 1 -- 172.21.15.46:0/258109005 wait complete. 2024-01-27T14:00:50.914 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-27T14:00:50.915 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-27T14:00:50.915 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:00:50.927 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-01-27T14:00:50.932+0000 b5cf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 40704) UID: 0 2024-01-27T14:00:50.928 INFO:tasks.ceph.mds.a.smithi046.stderr:2024-01-27T14:00:50.934+0000 b5cf640 -1 mds.a *** got signal Terminated *** 2024-01-27T14:00:51.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-01-27T14:00:57.017 INFO:tasks.ceph.mds.a:Stopped 2024-01-27T14:00:57.018 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-27T14:00:57.018 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:00:57.033 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-01-27T14:00:57.036+0000 b5cf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 40708) UID: 0 2024-01-27T14:00:57.034 INFO:tasks.ceph.mds.c.smithi046.stderr:2024-01-27T14:00:57.038+0000 b5cf640 -1 mds.c *** got signal Terminated *** 2024-01-27T14:00:57.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~7s 2024-01-27T14:01:03.119 INFO:tasks.ceph.mds.c:Stopped 2024-01-27T14:01:03.119 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-01-27T14:01:03.119 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:03.120 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-27T14:01:03.120 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-01-27T14:01:03.121 INFO:tasks.ceph.mds.e:Stopped 2024-01-27T14:01:03.121 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-27T14:01:03.122 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:03.136 INFO:tasks.ceph.mds.b.smithi078.stderr:2024-01-27T14:01:03.139+0000 b5cf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 40559) UID: 0 2024-01-27T14:01:03.137 INFO:tasks.ceph.mds.b.smithi078.stderr:2024-01-27T14:01:03.141+0000 b5cf640 -1 mds.b *** got signal Terminated *** 2024-01-27T14:01:04.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-01-27T14:01:04.872 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:01:04.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:01:09.223 INFO:tasks.ceph.mds.b:Stopped 2024-01-27T14:01:09.223 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-27T14:01:09.223 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:09.239 INFO:tasks.ceph.mds.d.smithi078.stderr:2024-01-27T14:01:09.242+0000 b5cf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 40561) UID: 0 2024-01-27T14:01:09.239 INFO:tasks.ceph.mds.d.smithi078.stderr:2024-01-27T14:01:09.244+0000 b5cf640 -1 mds.d *** got signal Terminated *** 2024-01-27T14:01:15.325 INFO:tasks.ceph.mds.d:Stopped 2024-01-27T14:01:15.325 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-01-27T14:01:15.325 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:15.342 INFO:tasks.ceph.mds.f.smithi078.stderr:2024-01-27T14:01:15.344+0000 b5cf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 40563) UID: 0 2024-01-27T14:01:15.343 INFO:tasks.ceph.mds.f.smithi078.stderr:2024-01-27T14:01:15.346+0000 b5cf640 -1 mds.f *** got signal Terminated *** 2024-01-27T14:01:21.427 INFO:tasks.ceph.mds.f:Stopped 2024-01-27T14:01:21.428 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-27T14:01:21.428 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-27T14:01:21.428 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:21.429 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:01:21.442+0000 7f8c9407e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 37065) UID: 0 2024-01-27T14:01:21.429 INFO:tasks.ceph.osd.0.smithi046.stderr:2024-01-27T14:01:21.442+0000 7f8c9407e640 -1 osd.0 36 *** Got signal Terminated *** 2024-01-27T14:01:27.530 INFO:tasks.ceph.osd.0:Stopped 2024-01-27T14:01:27.530 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-27T14:01:27.530 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:27.531 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T14:01:27.544+0000 7ff63e768640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 37069) UID: 0 2024-01-27T14:01:27.531 INFO:tasks.ceph.osd.1.smithi046.stderr:2024-01-27T14:01:27.544+0000 7ff63e768640 -1 osd.1 38 *** Got signal Terminated *** 2024-01-27T14:01:28.555 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:29:56.211 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.557 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:29:56.214 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.565 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:29:56.161 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.566 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:29:56.162 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.568 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:29:56.164 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.570 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:29:56.166 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.652 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:29:56.308 36729== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.662 INFO:tasks.ceph.mon.c.smithi078.stderr:==00:00:29:56.258 36303== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:28.666 INFO:tasks.ceph.mon.b.smithi078.stderr:==00:00:29:56.262 36302== Warning: unimplemented fcntl command: 1036 2024-01-27T14:01:33.632 INFO:tasks.ceph.osd.1:Stopped 2024-01-27T14:01:33.633 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-27T14:01:33.633 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:33.633 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:01:33.647+0000 7fae94473640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 37078) UID: 0 2024-01-27T14:01:33.634 INFO:tasks.ceph.osd.2.smithi046.stderr:2024-01-27T14:01:33.647+0000 7fae94473640 -1 osd.2 39 *** Got signal Terminated *** 2024-01-27T14:01:34.953 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:01:34.956 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:01:35.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-27T14:01:39.734 INFO:tasks.ceph.osd.2:Stopped 2024-01-27T14:01:39.734 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-27T14:01:39.734 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:39.737 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T14:01:39.751+0000 7f2fba40d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 37077) UID: 0 2024-01-27T14:01:39.737 INFO:tasks.ceph.osd.3.smithi046.stderr:2024-01-27T14:01:39.751+0000 7f2fba40d640 -1 osd.3 40 *** Got signal Terminated *** 2024-01-27T14:01:41.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-27T14:01:41.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-27T14:01:45.836 INFO:tasks.ceph.osd.3:Stopped 2024-01-27T14:01:45.836 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-27T14:01:45.837 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:45.838 INFO:tasks.ceph.osd.4.smithi078.stderr:2024-01-27T14:01:45.852+0000 7f4c37a84640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 36876) UID: 0 2024-01-27T14:01:45.838 INFO:tasks.ceph.osd.4.smithi078.stderr:2024-01-27T14:01:45.852+0000 7f4c37a84640 -1 osd.4 41 *** Got signal Terminated *** 2024-01-27T14:01:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-27T14:01:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-27T14:01:51.939 INFO:tasks.ceph.osd.4:Stopped 2024-01-27T14:01:51.939 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-27T14:01:51.939 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:51.940 INFO:tasks.ceph.osd.5.smithi078.stderr:2024-01-27T14:01:51.955+0000 7fd23168b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 36878) UID: 0 2024-01-27T14:01:51.941 INFO:tasks.ceph.osd.5.smithi078.stderr:2024-01-27T14:01:51.955+0000 7fd23168b640 -1 osd.5 42 *** Got signal Terminated *** 2024-01-27T14:01:53.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-27T14:01:58.041 INFO:tasks.ceph.osd.5:Stopped 2024-01-27T14:01:58.042 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-27T14:01:58.042 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:01:58.042 INFO:tasks.ceph.osd.6.smithi078.stderr:2024-01-27T14:01:58.056+0000 7f955e3e2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 36880) UID: 0 2024-01-27T14:01:58.043 INFO:tasks.ceph.osd.6.smithi078.stderr:2024-01-27T14:01:58.056+0000 7f955e3e2640 -1 osd.6 43 *** Got signal Terminated *** 2024-01-27T14:02:04.143 INFO:tasks.ceph.osd.6:Stopped 2024-01-27T14:02:04.144 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-27T14:02:04.144 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:02:04.145 INFO:tasks.ceph.osd.7.smithi078.stderr:2024-01-27T14:02:04.158+0000 7fce52de2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 36882) UID: 0 2024-01-27T14:02:04.145 INFO:tasks.ceph.osd.7.smithi078.stderr:2024-01-27T14:02:04.158+0000 7fce52de2640 -1 osd.7 43 *** Got signal Terminated *** 2024-01-27T14:02:05.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:02:05.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:02:10.245 INFO:tasks.ceph.osd.7:Stopped 2024-01-27T14:02:10.245 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-27T14:02:10.246 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-27T14:02:10.246 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:02:10.247 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:02:10.261+0000 7fe46e629640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 36743) UID: 0 2024-01-27T14:02:10.247 INFO:tasks.ceph.mgr.y.smithi046.stderr:2024-01-27T14:02:10.261+0000 7fe46e629640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-27T14:02:10.273 INFO:tasks.ceph.mgr.y:Stopped 2024-01-27T14:02:10.273 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-27T14:02:10.273 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:02:10.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-27T14:02:10.298 INFO:tasks.ceph.mgr.x:Stopped 2024-01-27T14:02:10.298 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-27T14:02:10.298 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-27T14:02:10.299 INFO:teuthology.orchestra.run:waiting for 300 2024-01-27T14:02:10.332 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-01-27T14:02:10.333+0000 9f79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 36706) UID: 0 2024-01-27T14:02:10.332 INFO:tasks.ceph.mon.a.smithi046.stderr:2024-01-27T14:02:10.335+0000 9f79640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-27T14:02:15.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-01-27T14:02:35.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:02:35.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:03:05.327 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:03:05.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:03:35.457 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:03:35.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:04:05.522 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:04:05.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:04:35.585 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:04:35.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:05:05.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:05:05.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:05:35.855 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:05:35.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:06:06.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:06:06.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:06:36.066 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:06:36.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:06.131 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:06.135 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:09.377 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-27T14:07:09.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-01-27T14:07:09.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:07:09.411 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-27T14:07:09.528 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:07:09.529 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-27T14:07:09.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:07:09.619 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-27T14:07:09.669 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:07:09.670 DEBUG:teuthology.orchestra.run.smithi046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-27T14:07:09.737 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T14:07:09.738 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-27T14:07:09.931 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T14:07:09.931 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-27T14:07:10.018 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T14:07:10.018 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-27T14:07:10.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T14:07:10.079 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-27T14:07:10.153 INFO:tasks.ceph:Archiving mon data... 2024-01-27T14:07:10.155 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/data/mon.a.tgz 2024-01-27T14:07:10.155 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-01-27T14:07:10.169 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.JjOIsJ0gOR 2024-01-27T14:07:10.169 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JjOIsJ0gOR 2024-01-27T14:07:10.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.JjOIsJ0gOR 2024-01-27T14:07:10.387 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.JjOIsJ0gOR is 307KB 2024-01-27T14:07:10.482 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.JjOIsJ0gOR 2024-01-27T14:07:10.496 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/data/mon.b.tgz 2024-01-27T14:07:10.496 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-01-27T14:07:10.513 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.pFrKcwZ75u 2024-01-27T14:07:10.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.pFrKcwZ75u 2024-01-27T14:07:10.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.pFrKcwZ75u 2024-01-27T14:07:10.738 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.pFrKcwZ75u is 339KB 2024-01-27T14:07:10.834 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.pFrKcwZ75u 2024-01-27T14:07:10.849 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/data/mon.c.tgz 2024-01-27T14:07:10.849 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-01-27T14:07:10.904 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.buy7VDCYf7 2024-01-27T14:07:10.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.buy7VDCYf7 2024-01-27T14:07:11.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.buy7VDCYf7 2024-01-27T14:07:11.115 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.buy7VDCYf7 is 350KB 2024-01-27T14:07:11.210 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.buy7VDCYf7 2024-01-27T14:07:11.225 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-27T14:07:11.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-27T14:07:11.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-27T14:07:11.550 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 52, column 1 (, line 52) 2024-01-27T14:07:11.555 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T14:07:11.768 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 52, column 1 (, line 52) 2024-01-27T14:07:11.815 ERROR:teuthology.util.scanner:Premature end of data in tag valgrindoutput line 3, line 52, column 1 (, line 52) 2024-01-27T14:07:11.815 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-27T14:07:11.816 INFO:tasks.ceph:Archiving crash dumps... 2024-01-27T14:07:11.818 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/remote/smithi046/crash 2024-01-27T14:07:11.818 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-27T14:07:11.844 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/remote/smithi078/crash 2024-01-27T14:07:11.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-27T14:07:11.871 INFO:tasks.ceph:Shutting down logrotate 2024-01-27T14:07:11.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:11.888 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:11.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:11.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-27T14:07:12.022 INFO:tasks.ceph:Compressing logs... 2024-01-27T14:07:12.023 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-27T14:07:12.038 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-27T14:07:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44605.log 2024-01-27T14:07:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30731.log 2024-01-27T14:07:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2024-01-27T14:07:12.062 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.tmp-client.admin.30731.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44605.log.gzgzip 2024-01-27T14:07:12.062 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-27T14:07:12.062 INFO:teuthology.orchestra.run.smithi046.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30731.log.gz 2024-01-27T14:07:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41342.log 2024-01-27T14:07:12.063 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gz 2024-01-27T14:07:12.063 INFO:teuthology.orchestra.run.smithi046.stderr:gzip/var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43925.log 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36614.log 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36614.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/valgrind/mon.c.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36614.log.gz 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr: 55.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-01-27T14:07:12.107 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/valgrind/mds.f.log: /var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr: 57.2% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36534.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr: 55.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36534.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36534.log.gz 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-27T14:07:12.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36745.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.7.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36694.log 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36654.log 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36694.log: 92.6% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36694.log.gz 2024-01-27T14:07:12.109 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36654.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36494.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-27T14:07:12.119 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36785.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2024-01-27T14:07:12.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.c.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-27T14:07:12.127 INFO:teuthology.orchestra.run.smithi078.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-27T14:07:12.133 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43859.log 2024-01-27T14:07:12.133 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43925.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41342.log.gz 2024-01-27T14:07:12.133 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-01-27T14:07:12.133 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43925.log.gz 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44929.log 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43859.log: /var/log/ceph/ceph-client.admin.43607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45351.log 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43859.log.gz 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44929.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44163.log 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45865.log 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45351.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44929.log.gz 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37193.log 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44163.log.gz 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.45865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43051.log 2024-01-27T14:07:12.134 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45351.log.gz 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37193.log: /var/log/ceph/ceph-client.admin.43051.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37193.log.gz 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41428.log 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48495.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43051.log.gz 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44437.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41428.log.gz 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.42537.log 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43844.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48831.log 2024-01-27T14:07:12.135 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45099.log 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42537.log: /var/log/ceph/ceph-client.admin.48831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45099.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48831.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45099.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43606.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.c.log: 57.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-01-27T14:07:12.136 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/client.0.log: /var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49521.log 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr: 55.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49563.log 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49521.log.gz 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41208.log 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48705.log: /var/log/ceph/ceph-client.admin.49563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2024-01-27T14:07:12.137 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41208.log: gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.48789.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49563.log.gz 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41208.log.gz 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43135.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41638.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48789.log: /var/log/ceph/ceph-client.admin.43135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43609.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48789.log.gz 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41638.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43135.log.gz 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48537.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4%/var/log/ceph/ceph-client.admin.43609.log: -- replaced with /var/log/ceph/ceph-client.admin.41638.log.gz 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41292.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47802.log 2024-01-27T14:07:12.138 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43609.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48537.log: /var/log/ceph/ceph-client.admin.41292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44792.log 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48537.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41292.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45225.log 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44221.log 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44792.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47802.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45225.log: gzip -5 --verbose 89.1% -- /var/log/ceph/ceph-client.admin.49187.log -- replaced with /var/log/ceph/ceph-client.admin.44792.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45225.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43177.log 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44221.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49187.log.gz 2024-01-27T14:07:12.139 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48915.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44353.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43177.log.gz 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48915.log.gz 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49126.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48873.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44353.log.gz 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48957.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 2024-01-27T14:07:12.140 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48873.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49126.log.gz 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42847.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48873.log.gz 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43261.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz --verbose 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr: -- /var/log/ceph/ceph-client.admin.42889.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42847.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47676.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42889.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42847.log.gz 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.42889.log.gz 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44535.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47676.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44322.log 2024-01-27T14:07:12.141 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47676.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44647.log 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44322.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44535.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44844.log 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3%/var/log/ceph/ceph-client.admin.44647.log: -- replaced with /var/log/ceph/ceph-client.admin.44322.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44689.log 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44844.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44647.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44844.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44689.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44283.log 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43602.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2024-01-27T14:07:12.142 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36745.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48071.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44283.log.gz 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49311.log: /var/log/ceph/ceph-client.admin.36745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49269.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47945.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48071.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.36745.log.gz 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45183.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48071.log.gz 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47903.log 2024-01-27T14:07:12.143 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47945.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49269.log.gz 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45183.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47945.log.gz 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43093.log 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45183.log.gz 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42763.log 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49227.log 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43093.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47903.log.gz 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42763.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43093.log.gz /var/log/ceph/ceph-osd.1.log 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49083.log 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49227.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42763.log.gz 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2024-01-27T14:07:12.144 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49227.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44971.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49083.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-client.admin.37084.log 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44143.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.48273.log 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.37084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48453.log 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48273.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37084.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48453.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48273.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41680.log 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48453.log.gz 2024-01-27T14:07:12.145 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48621.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48113.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48113.log: 88.9% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.41680.log.gz 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48621.log.gz 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43387.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48113.log.gz 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42495.log: /var/log/ceph/ceph-client.admin.43387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41124.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43387.log.gz/var/log/ceph/ceph-client.admin.43303.log: gzip 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45141.log 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5%/var/log/ceph/ceph-client.admin.41124.log: -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2024-01-27T14:07:12.146 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42435.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41124.log.gz 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44497.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45141.log.gz 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41166.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42435.log.gz/var/log/ceph/ceph-client.admin.44497.log: 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44263.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44497.log.gz 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41166.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41166.log.gz 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44263.log.gz 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43867.log 2024-01-27T14:07:12.147 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43867.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9%/var/log/ceph/ceph-client.admin.41040.log: -- replaced with /var/log/ceph/ceph-client.admin.43867.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45478.log 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41512.log 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42393.log 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45478.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44002.log 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41512.log: /var/log/ceph/ceph-client.admin.42393.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41512.log.gz 2024-01-27T14:07:12.148 INFO:teuthology.orchestra.run.smithi046.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42393.log.gz 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45267.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44002.log.gz 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48029.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43009.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45267.log.gz 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48029.log: /var/log/ceph/ceph-client.admin.43009.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48029.log.gz 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44731.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49479.log 2024-01-27T14:07:12.149 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz/var/log/ceph/ceph-client.admin.44731.log: 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44731.log.gz 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr: /var/log/ceph/ceph-mds.e.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49479.log.gz 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49353.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49353.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49353.log.gz 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41386.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41386.log: /var/log/ceph/ceph-mgr.y.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41386.log.gz 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43601.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-01-27T14:07:12.150 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40608.log 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41250.log 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr: 87.1%/var/log/ceph/ceph-client.admin.40608.log: -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40608.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41250.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41250.log.gz 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49395.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2024-01-27T14:07:12.151 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40723.log 2024-01-27T14:07:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-01-27T14:07:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40723.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40723.log.gz 2024-01-27T14:07:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41746.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-01-27T14:07:12.153 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45057.log 2024-01-27T14:07:12.160 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42805.log 2024-01-27T14:07:12.161 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45057.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45057.log.gz 2024-01-27T14:07:12.168 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-27T14:07:12.180 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47987.log 2024-01-27T14:07:12.180 INFO:teuthology.orchestra.run.smithi046.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42805.log.gz 2024-01-27T14:07:12.184 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph.log: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-27T14:07:12.187 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-27T14:07:12.197 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-01-27T14:07:12.200 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-osd.2.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47987.log.gz 2024-01-27T14:07:12.214 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44477.log 2024-01-27T14:07:12.214 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43835.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-01-27T14:07:12.226 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-27T14:07:12.227 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.44477.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44477.log.gz 2024-01-27T14:07:12.235 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47718.log 2024-01-27T14:07:12.243 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.c.log: 92.7%gzip -5/var/log/ceph/ceph-client.admin.47718.log: --verbose -- /var/log/ceph/ceph-client.admin.41596.log 2024-01-27T14:07:12.243 INFO:teuthology.orchestra.run.smithi046.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47718.log.gz 2024-01-27T14:07:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47760.log 2024-01-27T14:07:12.249 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-27T14:07:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41596.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41596.log.gz 2024-01-27T14:07:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40995.log 2024-01-27T14:07:12.249 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47760.log.gz 2024-01-27T14:07:12.269 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2024-01-27T14:07:12.269 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40995.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40995.log.gz 2024-01-27T14:07:12.277 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2024-01-27T14:07:12.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42169.log: 92.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41470.log 2024-01-27T14:07:12.287 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43610.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2024-01-27T14:07:12.291 INFO:teuthology.orchestra.run.smithi046.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2024-01-27T14:07:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42721.log 2024-01-27T14:07:12.300 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41470.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41470.log.gz 2024-01-27T14:07:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48357.log 2024-01-27T14:07:12.309 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42721.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42721.log.gz 2024-01-27T14:07:12.317 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-01-27T14:07:12.318 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48357.log.gz 2024-01-27T14:07:12.338 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48315.log 2024-01-27T14:07:12.338 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43599.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-01-27T14:07:12.346 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2024-01-27T14:07:12.349 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48315.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48315.log.gz 2024-01-27T14:07:12.360 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48400.log 2024-01-27T14:07:12.361 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48579.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2024-01-27T14:07:12.369 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43929.log 2024-01-27T14:07:12.383 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48400.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48400.log.gz 2024-01-27T14:07:12.384 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47634.log 2024-01-27T14:07:12.385 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43929.log.gz 2024-01-27T14:07:12.395 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45309.log 2024-01-27T14:07:12.396 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.47634.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47634.log.gz 2024-01-27T14:07:12.405 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40853.log 2024-01-27T14:07:12.406 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.45309.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45309.log.gz 2024-01-27T14:07:12.414 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41554.log 2024-01-27T14:07:12.420 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40853.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-27T14:07:12.421 INFO:teuthology.orchestra.run.smithi046.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40853.log.gz 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42579.log 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.41554.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41554.log.gz 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49437.log 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.42579.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42579.log.gz 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.49437.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49437.log.gz 2024-01-27T14:07:12.425 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48747.log 2024-01-27T14:07:12.433 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-mds.a.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-27T14:07:12.433 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-01-27T14:07:12.433 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48747.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48747.log.gz 2024-01-27T14:07:12.435 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40787.log 2024-01-27T14:07:12.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.43611.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-01-27T14:07:12.435 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48999.log 2024-01-27T14:07:12.435 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.40787.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40787.log.gz 2024-01-27T14:07:12.436 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.admin.48999.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48999.log.gz 2024-01-27T14:07:12.707 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/ceph-mon.b.log: file size changed while zipping 2024-01-27T14:07:12.707 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-27T14:07:12.818 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/ceph-mon.c.log: file size changed while zipping 2024-01-27T14:07:12.818 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-27T14:07:13.055 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:35:40.712 36729== 2024-01-27T14:07:13.055 INFO:tasks.ceph.mon.a.smithi046.stderr:==00:00:35:40.712 36729== Exit program on first error (--exit-on-first-error=yes) 2024-01-27T14:07:13.077 INFO:tasks.ceph.mon.a.smithi046.stderr:daemon-helper: command failed with exit status 42 2024-01-27T14:07:13.443 INFO:teuthology.orchestra.run.smithi046.stderr:gzip: /var/log/ceph/ceph-mon.a.log: file size changed while zipping 2024-01-27T14:07:13.461 INFO:teuthology.orchestra.run.smithi046.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-27T14:07:14.485 INFO:teuthology.orchestra.run.smithi078.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-27T14:07:14.750 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-27T14:07:15.024 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-27T14:07:15.436 INFO:teuthology.orchestra.run.smithi078.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-27T14:07:15.768 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-27T14:07:15.770 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-01-27T14:07:15.770 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m3.685s 2024-01-27T14:07:15.770 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m13.263s 2024-01-27T14:07:15.770 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.417s 2024-01-27T14:07:16.094 INFO:teuthology.orchestra.run.smithi046.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-27T14:07:16.362 INFO:teuthology.orchestra.run.smithi046.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-27T14:07:17.392 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-27T14:07:17.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-27T14:07:22.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-01-27T14:07:23.553 INFO:teuthology.orchestra.run.smithi046.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.45865.log.gz 2024-01-27T14:07:28.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2024-01-27T14:07:31.483 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-01-27T14:07:31.485 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-01-27T14:07:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m19.435s 2024-01-27T14:07:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m47.216s 2024-01-27T14:07:31.485 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m1.447s 2024-01-27T14:07:31.485 INFO:tasks.ceph:Archiving logs... 2024-01-27T14:07:31.485 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/remote/smithi046/log 2024-01-27T14:07:31.486 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-27T14:07:33.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~16s 2024-01-27T14:07:38.065 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/remote/smithi078/log 2024-01-27T14:07:38.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-27T14:07:38.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~21s 2024-01-27T14:07:40.248 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T14:07:40.249 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-27T14:07:40.258 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_99a21c3b6c137f933ecc0074a260e59bd4ba2a7f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T14:07:40.259 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-27T14:07:40.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-27T14:07:40.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-27T14:07:40.345 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-27T14:07:40.354 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-27T14:07:40.354 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T14:07:40.356 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-27T14:07:40.370 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-01-27T14:07:40.372 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-01-27T14:07:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T14:07:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-01-27T14:07:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 45 +235us[ +235us] +/- 73ms 2024-01-27T14:07:40.376 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 +1284us[+1295us] +/- 65ms 2024-01-27T14:07:40.376 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -1884us[-1873us] +/- 81ms 2024-01-27T14:07:40.376 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:07:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-27T14:07:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-01-27T14:07:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +224us[ +224us] +/- 73ms 2024-01-27T14:07:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 +1238us[+1250us] +/- 65ms 2024-01-27T14:07:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -1920us[-1920us] +/- 81ms 2024-01-27T14:07:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-27T14:07:40.378 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-27T14:07:40.387 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-27T14:07:40.387 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-27T14:07:40.396 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-27T14:07:40.497 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-27T14:07:40.565 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T14:07:40.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:07:40.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-27T14:07:40.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:07:40.626 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-27T14:07:40.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-27T14:07:40.646 INFO:teuthology.task.internal:Duration was 2958.041856 seconds 2024-01-27T14:07:40.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-27T14:07:40.655 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-27T14:07:40.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-27T14:07:40.658 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-27T14:07:40.700 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T14:07:40.708 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-27T14:07:40.937 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-27T14:07:40.938 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-01-27T14:07:40.938 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-27T14:07:40.958 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-01-27T14:07:40.958 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-27T14:07:40.994 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-27T14:07:40.994 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-27T14:07:41.000 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-27T14:07:41.063 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-27T14:07:41.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-27T14:07:41.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-27T14:07:41.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-27T14:07:41.225 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-27T14:07:41.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-27T14:07:41.253 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-27T14:07:41.280 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-27T14:07:41.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-27T14:07:41.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-27T14:07:41.317 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-01-27T14:07:41.345 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-01-27T14:07:41.369 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-27T14:07:41.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:07:41.386 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-27T14:07:41.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-27T14:07:41.424 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-27T14:07:41.435 INFO:teuthology.task.internal:Transferring archived files... 2024-01-27T14:07:41.435 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/remote/smithi046 2024-01-27T14:07:41.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-27T14:07:41.471 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443/remote/smithi078 2024-01-27T14:07:41.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-27T14:07:41.506 INFO:teuthology.task.internal:Removing archive directory... 2024-01-27T14:07:41.507 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-27T14:07:41.509 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-27T14:07:41.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-27T14:07:41.568 INFO:teuthology.task.internal:Not uploading archives. 2024-01-27T14:07:41.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-27T14:07:41.578 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-27T14:07:41.578 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-27T14:07:41.581 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-27T14:07:41.592 INFO:teuthology.orchestra.run.smithi046.stdout: 265303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 27 14:07 /home/ubuntu/cephtest 2024-01-27T14:07:41.611 INFO:teuthology.orchestra.run.smithi078.stdout: 266019 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 27 14:07 /home/ubuntu/cephtest 2024-01-27T14:07:41.612 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-27T14:07:41.624 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-27T14:07:41.635 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-01-27T14:07:41.635 INFO:teuthology.nuke:Checking targets against current locks 2024-01-27T14:07:41.663 DEBUG:teuthology.nuke:shortname: smithi046 2024-01-27T14:07:41.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-27T14:07:41.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 13:10:16.272142', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSiUJLD7NupzrbLNMQlJkAwwNfMl33iRfrA6vxAJLhAVxjq3Ty5GbVp6DlyXBbJp/VdpttpZSFScR0DKKRdIv8='} 2024-01-27T14:07:41.691 DEBUG:teuthology.nuke:shortname: smithi078 2024-01-27T14:07:41.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-27T14:07:41.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:05:59-fs-main-distro-default-smithi/7534443', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 13:10:16.274197', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAM43CzzKNHAgRaevX71/zsxlDd9gm3zQ//qqeybgcK1bd5MV8ACud4PV6AJPCj8K49YmP2/mjYFQEgbCuxvt1Q='} 2024-01-27T14:07:41.732 INFO:teuthology.orchestra.console.smithi046:Power off 2024-01-27T14:07:41.732 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T14:07:41.759 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-01-27T14:07:41.759 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T14:07:41.774 INFO:teuthology.orchestra.console.smithi078:Power off 2024-01-27T14:07:41.774 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-27T14:07:41.783 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-27T14:07:41.796 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2024-01-27T14:07:41.797 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T14:07:41.819 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-01-27T14:07:43.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~26s 2024-01-27T14:07:45.785 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T14:07:45.820 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T14:07:45.894 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-27T14:07:45.933 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-01-27T14:07:48.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~31s 2024-01-27T14:07:48.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-27T14:07:48.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-27T14:07:49.896 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T14:07:49.934 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-27T14:07:50.006 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-01-27T14:07:50.044 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-01-27T14:07:50.107 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-01-27T14:07:50.146 INFO:teuthology.orchestra.console.smithi078:Power off completed 2024-01-27T14:07:50.250 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 2958.0418560504913 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-01-27T14:07:50.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-27T14:07:50.327 INFO:teuthology.run:FAIL